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ABSTRACT 


Sensitivity  tenting  as  applied  to  one-shot  items  consists  of  subjecting 
individual  one-shot  test  items  to  discrete  levels  of  a  test  environment,  operat¬ 
ing  the  test  item  and  noting  whether  or  not  the  item  functions  properly.  From 
this  type  of  test  a  direct  measurement  of  the  strength  of  the  test  item  is  not 
obtained,  only  the  information  that  the  strength  is  either  greater  than  or  less 
than  the  test  level  used.  In  order  to  obtain  more  meaningful  information  from 
these  "quantal  response"  data  it  is  necessary  to  use  special  techniques  or 

procedures  both  to  conduct  the  tests  and  to  analyze  the  data. 

This  investigation  was  directed  toward  testing  one-shot  items  associated 
with  Army  missiles,  e.  g. ,  thermal  batteries,  squibs,  explosive,  etc.  The 
specific  objectives  of  the  investigations  were  (1)  to  evaluate  available  tech¬ 
niques  for  conducting  sensitivity  tests  of  one-shot  items,  (2)  to  improve  exist¬ 
ing  techniques  or  develop  an  improved  one,  (3)  to  identify  the  best  technique, 
and  (4)  to  identify  and  evaluate  any  limitations  of  the  best  technique  as 
identified  from  (3)  above. 

The  approach  taken  was  to  simulate  sensitivity  testing  with  the  different 
techniques  on  a  digital  computer.  A  simulation  program  was  developed  and  the 
different  techniques  programmed  for  testing  under  closeby  controlled  conditions. 
In  this  wajr  it  was  possible  to  control  all  inputs,  providing  accurate  data  for 
comparison  and  evaluation  of  the  testing  techniques, 
ii 
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The  Bruceton  or  Up  and  Down  technique,  and  a  technique  developed  by  an 
Army  missile  contractor  referred  to  as  the  missile  technique,  were  the  two 
techniques  given  primary  consideration.  The  investigations  revealed  that  the 
missile  technique  was  superior  to  the  standard  Bruceton  in  providing  estimates 
of  the  mean  failure  strength  of  test  items.  The  missile  technique  estimates 
were  from  1  to  32  percent  more  efficient  than  the  Bruceton.  Other  character¬ 
istics  of  both  techniques  were  evaluated  and  specific  limitations  of  each  tech¬ 
nique  identified. 
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CHAPTER  I 


INTRODUCTION  AND  BACKGROUND 


1.  The  Requirement  for  Sensitivity  Testing 

Sensitivity  testing  consists  of  testing  items  at  increasingly  severe  test 
levels  and  noting  the  effects  on  the  operation  or  functioning  of  the  item.  A 
variation  of  this  technique  is  the  test-to-failure  (TTF)  approach  wherein  the 
test  levels  are  deliberately  increased  to  the  point  at  which  failure  occurs,  thus 
determining  the  inherent  test  item  strength.  Usually  in  this  situation  it  is 
possible  to  operate  the  test  item  long  enough  to  hunt  for  the  exact  value  of  the 
test  environment  which  causes  failure.'  But  for  a  certain  class  of  hardware, 
known  as  "one-shot"  items,  this  is  not  possible  due  to  their  extremely  short 
operating  lives.  To  conduct  sensitivity  tests  of  these  items  it  is  necessary  to 
select  a  single,  discrete  value  or  level  of  the  test  environment,  subject  the 
item  to  this  test  level,  then  operate  the  item  and  note  whether  or  not  it  func¬ 
tions  properly.  A  direct  measurement  of  the  strength  of  the  test  item  is  not 
obtained,  only  the  information  that  the  strength  is  either  greater  than  or  less 
than  the  test  level  used.  This  type  of  data  is  known  in  various  forms  as  "all 
or  none"  data,  "sensitivity"  data,  and  "quantal  responses."  In  order  to 
obtain  more  meaningful  information  from  quantal  response  data  it  is  necessary 
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to  use  special  techniques  or  procedures  to  both  conduct  the  tests  and  analyze 
the  data. 

The  primary  objective  of  testing  as  described  above  is  to  obtain  a 
measure  of  the  strength  of  the  test  item  and  the  variation  of  the  strength  within 
a  group  or  population  of  test  items.  Testing  must  therefore  produce  data  from 
which  statistical  estimates  of  the  mean  strength,  x,  and  standard  deviation,  s, 
can  be  calculated.  These  estimates  may  then  be  used  for  various  evaluations 
of  the  test  items  as  required.  One  of  the  earlier  requirements  for  sensitivity 
testing  of  one-shot  items  and  analysis  of  the  quantal  responses  appeared  in 
the  field  of  biological  assay. 1  The  requirement  here  was  to  estimate  the 
mean  response  of  a  subject  (some  living  matter  such  as  an  animal,  a  piece  of 
animal  tissue,  a  plant,  or  a  bacterial  culture)  to  a  stimulus  (a  vitamin,  a 
drug,  or  a  fungicide) .  In  this  situation  the  intensity  of  the  stimulus  is  usually 
varied  by  varying  the  measured  dosage  of  the  stimulus.  The  mean  response  is 
expressed  as  the  dosage  which  produces  the  specified  response.  The  specified 
response  could  be  weight  gain,  an  analytical  value  such  as  sugar  count  or  pulse 
rate,  death,  or  some  other  measurable  bodily  characteristic. 

In  the  general  area  of  explosives  research,  sensitivity  testing  with 
quantal  responses  assumes  a  major  role.  Interest  in  the  sensitivity  of  explo¬ 
sives  has  been  heightened  during  recent  years  by  the  increased  use  of  solid 
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propellant  rockets  in  military  applications  and  liquid  prot>ellant  rockets  in  both 
military  and  space  exploration  applications,  and  the  associated  safety  aspects. 
It  should  also  be  noted  that  the  safety  problems  associated  with  tactical  military 
rockets  are  greatly  complicated  by  the  inherent  field  handling  environment  to 
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which  such  rockets  are  exposed. 

This  greatly  increased  concern  with  the  safety  aspect  of  explosives  has 
resulted  in  the  development  and  use  of  many  techniques  for  the  testing  and 
measuring  of  explosive  sensitivity. 2  The  great  majority  of  these  sensitivity 
testing  techniques  result  in  quantal  response  data. 

Usually  these  data  are  analyzed  to  provide  a  statistical  estimate  of  the 
mean  value  of  some  physical  stimulus  which  produces  explosions  in  the  test 
specimen.  This  information  is  then  used  to  establish  a  qualitative  evaluation 
of  the  particular  explosive  being  tested.  The  evaluation  usually  consists  of 
comparing  the  mean  value  of  the  stimulus  with  similar  results  for  other 
explosives,  establishing  a  relative  sensitivity  ranking.  The  stimuli  used  in 
these  sensitivity  tests  have  included  impact  of  a  weight  falling  from  a  measured 
height, 3  sympathetic  detonation  by  a  donor  charge  of  a  specified  size  and  type 
operating  through  a  controlled  medium, 4,5  and  container  diameter  for  detona¬ 
tion  propagation. 6 

Another  technological  area  which  has  generated  requirements  for  the 
statistical  analysis  of  quantal  data  is  the  development  of  electro- explosive 
devices  (EED) .  This  area  has  also  been  stimulated  in  recent  years  by  the 
increased  emphasis  on  military  and  space  rocket  programs. 

Electro-explosive  devices  are  devices  used  on  rockets  to  perform  func¬ 
tions  such  as  initiation  of  the  main  propulsion  system  and  warheads,  separa¬ 
tion  of  stages,  initiation  of  power  supplies,  and  operating  valves.  It  is  evident 
that  if  an  EED  which  initiates  the  propulsion  system  or  warhead  of  a  rocket  is 
inadvertently  initiated  at  any  time  after  manufacture,  a  disastrous  accident 
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could  result.  It  la  known  that  ESD's  can  be  initiated  by  ambient  electromag¬ 
netic  energy  from  miscellaneous  sources  in  the  vicinity  if  these  energy  levels 
are  high  enough. 7  It  is  therefore  necessary  that  the  sensitivity  characteristics 
of  EED's  be  well  defined  and  only  those  which  are  compatible  with  the  electro¬ 
magnetic  environment  be  used. 

The  analysis  of  quantal  response  data  also  plays  an  important  role  in 
reliability  evaluation.  There  are  many  items,  both  commercial  and  military, 
which  exhibit  one-shot  performance  and  produce  quantal  response  data  when 
tested.  Here,  as  in  the  associated  area  of  quality  assurance  testing,  the 
primary  emphasis  is  on  calculating  the  mean  critical  response  value  above 
which  the  item  fails  and  below  which  it  operates  properly.  It  is  also  necessary 
to  analyze  the  data  to  obtain  an  estimate  of  the  standard  deviation  which  is 
needed  to  establish  confidence  levels  for  reliability  estimates  and  f6r  hypothesis 
testing  as  used  in  quality  assurance  activities. 


2.  Sensitivity  Testing  of  Missile  and  Rocket  Hardware 

The  technological  areas  described  to  this  point  generated  the  original 
requirements  for  analysis  of  quantal  response  data.  It  is  pertinent  to  note  that 
all  these  technologies,  with  the  exception  of  bio-assay  work,  are  included  in 
rocket  and  missile  development.  As  a  result,  the  analysis  of  quantal  response 
data  has  received  a  tremendous  amount  of  attention  by  the  industries  working  in 
this  area  as  well  as  by  the  responsible  government  military  and  space 
agencies.  The  technical  complexity  of  the  hardware  being  developed  and  the 
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corresponding  high  cost  of  this  hardware  have  placed  emphasis  on  being  able 
to  completely  understand  its  operation  and  reduce  the  possibility  ( f 
performance  failures. 

A  further  complicating  factor  for  military  hardware  is  the  use  environ¬ 
ment  to  which  the  hardware  is  exposed.  This  environment  includes  all  the 
conditions  present  from  the  time  the  hardware  leaves  the  production  line  until 
it  is  expended  in  the  field.  The  use  environment  of  army  equipment  is  thought 
to  be  the  most  severe,  presenting  the  greatest  challenge  to  the  developer  of 
such  hardware.  Thus  the  testing  problem  presented  by  one-shot  items  used  in 
army  missiles  is  especially  significant. 

Generally,  development  testing  of  missile  hardware  has  the  following 
broad  objectives:  (1)  to  determine/ verify  design  characteristics,  (2)  to 
assess  reliability,  and  (3)  to  determine  safety  characteristics.  For  one-shot 
items,  test-to-failure  data  may  be  used  to  satisfy  all  three  of  these  objectives. 
To  do  this  the  concept  of  "safety  margins"  is  used. 

The  use  of  safety  margins  was  first  advocated  by  Robert  Lusser. 8  The 
advantage  of  this  philosophy  as  opposed  to  qualification  testing,  for  example, 

i 

is  that  statements  regarding  very  high  reliability  can  be  made  with  reasonable  ' 
confidence  on  the  basis  of  relatively  small  samples. 

Design  evaluation  by  safety  margin  is  accomplished  by  testing  the 
critical  components  of  the  missile  in  their  most  critical  operating  environ¬ 
ment.  The  test-to-failure  establishes  the  mean  level  of  the  environment  at 
which  the  component  will  fail.  This  value  is  then  compared  with  the  environ¬ 
mental  level  at  which  the  component  is  required  to  operate  and  the  safety 
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margin  established.  Since  the  standard  deviation  can  also  be  calculated  from 
the  test-to- failure  data,  the  safety  margin  can  be  expressed  as  so  many 
standard  deviations,  or  sigmas.  The  greater  the  number  of  sigmas,  the  better 
the  design.  The  components  which  have  safety  margins  of  only  2  or  3  sigmas 
would  be  considered  marginal  and  would  have  to  be  redesigned.  A  component 
with  too  large  a  safety  margin  could  be  considered  over-designed,  and 
redesigned  if  desired. 

The  same  information  (i.  e. ,  safety  margins  expressed  as  a  number  of 
sigmas  above  a  required  level)  could  be  evaluated  for  reliability  by  referring 
to  tables  for  the  standardized  Normal  deviate.  By  doing  this  it  is  possible  to 
express  the  reliability  of  the  component  for  operation  at  the  required  environ¬ 
ment  level.  Safety  assessment  may  be  accomplished  by  using  either  of  the  two 
procedures. 9 


3.  Program  Objectives 

The  particular  aspect  of  testing  one-shot  items  of  army  missile  hard¬ 
ware  and  evaluating  the  results  as  described  above  is  the  general  subject  of 
this  paper.  More  specifically,  investigations  of  the  statistical  analysis  of  the 
quantal  response  data  within  the  constraints  imposed  by  army  missile  hardware 
are  described.  The  specific  objectives  of  these  investigations  were  (1)  to 
evaluate  available  techniques  for  conducting  sensitivity  tests,  (2)  to  improve 
existing  techniques  or  develop  an  improved  one,  (3)  to  identity  the  best  tech¬ 
nique,  and  (4)  to  identify  and  evaluate  any  limitations  of  the  best  technique  as 
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identified  from  (3)  above. 


The  approach  taken  was  to  simulate  sensitivity  testing  with  the  different 
techniques  on  a  digital  computer.  A  simulation  program  was  developed  and  the 
different  techniques  programmed  for  testing  under  r,losely  controlled  conditions. 
In  this  way  it  was  possible  to  control  all  inputs,  providing  accurate  data  for 
comparison  and  evaluation  of  the  testing  techniques. 


4.  Selection  of  Techniques  for  Evaluation 

If  quantal  data  analysis  techniques  which  are  nonparametric,  such  as 
the  Spearman-Karber10  and  Robbins- Monro 11  methods,  are  ruled  out  because  of 
the  relatively  large  sample  sizes  required,  the  choice  of  which  technique  to  use 
is  one  between  the  Probit12,13  and  Bruceton.  14,15  Investigations  by  Gayle16  in 
which  the  Probit  and  Bruceton  techniques  were  used  to  analyze  identical  sets 
of  data  under  closely  controlled  conditions  reveal  that  the  Bruceton  estimates 
are,  in  general,  superior  to  the  Probit  estimates  for  equal  sample  sizes. 

Since  test  costs  (and  hence  sample  sizes)  are  the  predominate  factors  in  any 
sensitivity  test  program  (except  perhaps  in  the  field  of  medicine),  the  Probit 
technique  was  eliminated  from  further  consideration. 

In  rejecting  the  nonparametric  techniques  and  the  Probit  technique 
solely  on  the  fact  that  more  samples  of  test  hardware  are  required,  more 
elaboration  on  this  point  is  indicated.  The  primary  field  of  sensitivity  testing 
being  considered  is  the  aerospace  field,  more  specifically  military  missile  and 
rocket  components.  Included  are  such  items  as  thermal  batteries,  explosive 


switches  and  relays,  special  infrared  and  visible  light  sources,  gyroscopes, 
and  solid  propellant  rocket  motors.  These  itemB,  especially  when  produced 
in  small,  development-sized  quantities,  can  be  two  or  three  orders  of  magni¬ 
tude  more  expensive  than  laboratory  specimen  or  test  animals  used  in  dosage 
mortality  and  biological  assay  work.  Further,  the  actual  testing  of  the  afore¬ 
mentioned  hardware  (e.g. ,  vibration  testing  of  a  gyro)  can  cost  orders  of 
magnitude  more.  Thus  any  reduction  in  sample  size  at  all  can  result  in  a  very 
substantial  savings  of  test  program  costs.  One  further  point  is  that  laboratory 
tests  in  which  the  Probit  technique  is  used  are  usually  more  conducive  to 
concurrent  testing  of  individual  test  specimens;  that  is,  the  testing  of  twenty 
mice  by  injecting  them  with  a  serum  is  more  practical  than  testing  them  one  at 
a  time.  The  opposite  is  generally  true  with  aerospace  hardware.  There 
usually  are  not  enough  facilities  or  the  tests  are  too  hazardous  to  permit 
testing  more  than  a  few  items  at  a  time. 

Thus,  a  technique  for  analyzing  quantal  data  is  desired  which  will 
provide  reasonably  accurate  statistical  estimates  from  relatively  small 
samples  of  test  hardware,  and  which  will  allow  tests  to  be  conducted  essentially 
one  at  a  time.  Based  on  the  author's  personal  experience  it  is  felt  that 
"relatively  small  samples"  should  be  interpreted  as  meaning  sample  sizes  of 
up  to  40  to  50  specimens  maximum  allowed,  and  samples  of  15  to  25  specimens 
desired.  Based  on  the  information  discussed  to  this  point,  the  Bruceton  tech¬ 
nique  more  nearly  meets  these  restrictions. 

There  is  another  technique  for  sensitivity  testing  which  was  designed 
for  and  used  during  development  and  production  testing  of  a  U.  S.  Army 
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missile  system. 17  This  technique,  which  will  be  called  the  Missile  technique, 
permits  one-at-a-time  testing  and  can  be  used  with  sample  sizes  as  small  as 
15  specimens.  It  appeared  to  be  superior  to  the  Bruceton  in  sample  size 
requirements  and  thus  more  suitable  for  aerospace  sensitivity  testing.  Thus, 
the  choice  of  which  technique  to  use  was  between  the  Bruceton  and  Missile 
techniques,  with  the  ultimate  answer  being  br  primarily  on  sample  size 
required  and  accuracy. 

There  ar*1  number  of  similarities  between  the  Bruceton  and  Missile 
techniques.  Both  require  the  assumption  that  the  critical  responses  be  distri¬ 
buted  Normally.  Both  also  provide  maximum  likelihood  estimates  of  the 
statistical  parameters.  The  test  levels  required  by  both  techniques  are 
generated  sequentially,  the  levels  being  determined  irtially  from  earlier 
results  as  testing  progresses  through  the  sample. 

The  most  apparent  difference  between  the  Bruceton  and  Missile  methods 
is  the  manner  in  which  the  individual  test  levels  are  generated  as  the  test 
program  progresses.  The  test  level  for  a  particular  Bruceton  test  item  is  set 
at  a  constant  increment  above  or  below  the  previous  test  level,  depending  upon 
whether  or  not  the  previous  test  was  a  success  or  a  failure.  A  test  level  for 
the  Missile  method  is  also  dependent  upon  the  results  of  the  previous  item 
tested.  In  this  method,  however,  the  increment  by  which  the  previous  test 
level  is  changed  is  not  a  constant,  but  is  varied  according  to  a  simple 
algorithm 

A  further  basic  difference  between  the  two  methods  is  that  the  Missile 
» '*■  ‘ 

method  requires  no  a  priori  assumptions  regarding  the  mean  or  standard 
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deviation  of  critical  responses.  The  Bruceton  method  requires  estimates  of 
both  before  the  tests  can  be  planned.  The  accuracy  of  these  estimates  has  a 
direct  influence  on  the  efficiency  of  the  test  program. 


5.  The  Assumption^  Normality 

Since  these  were  basically  the  only  techniques  considered  for  further 
investigation,  the  Normality  assumption  common  to  both  should  be  discussed 
in  more  detail.  The  requirement  of  this  assumption  is  that  the  critical 
response  or  some  transformation  of  it  be  distributed  Normally.  This  require¬ 
ment  is  not  considered  to  be  particularly  restrictive  since  there  are  many 
functions  which  might  provide  the  required  transformation.  Also  the  Normal 
distribution  is  the  most  common  one  found  in  nature  and  could  reasonably  be 
expected  to  occur  frequently  with  aerospace  hardware.  That  this  is  true  has 
been  well  documented  by  test  results  from  the  biological  assay  field, 1  many 
tests  of  EED's,9  explosive  shock  sensitivity  test  data, 3’4,5, 18  and  metal  fatigue 
testing.  19 

The  alternatives  to  an  assumption  of  Normality  (or  any  other  form  of 
distribution)  are  either  (1)  the  use  of  nonparametric  (distribution  free)  tech¬ 
niques  or  (2)  conducting  enough  tests  to  determine  the  form  of  the  distribu¬ 
tion.  Neither  of  these  is  considered  practical  because  of  the  large  sample 
sizes  required. 20  Hence,  the  situation  is  that  an  assumption  be  accepted  about 
the  form  of  the  distribution,  or  no  practical  technique  is  available  at  all. 

The  effects  of  using  the  Normal  assumption  with  non-Normal  data  have 
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been  investigated  by  Gayle16  and  Hampton. 21  The  general  conclusion  from 
these  investigations  is  that  the  Bruceton  tests  provided  results  which  were 
"optimistic. "  That  is,  the  standard  deviation  estimates  were  smaller  than  the 
actual  population  standard  deviation.  By  using  the  concept  of  "safety  margins" 
as  described  by  Lusser, 8  this  problem  is  minimized. 


6.  Other  Characteristics  of  the  Bruceton  and  Miseile  Techniques 

In  considering  the  choice  between  the  Bruceton  and  the  Missile  tech¬ 
niques  ,  it  is  pertinent  to  realize  that  the  Bruceton  has  been  in  use  much  longer 
than  the  Missile  technique.  The  Bruceton  was  first  described  in  open  litera¬ 
ture  in  1944  and  since  that  time  has  been  used  many  times  by  investigators  in 
various  experimental  situations.  It  would  thus  appear  that  the  Bruceton  tech¬ 
nique  should  be  better  defined  and  its  capabilities  well  documented.  This  does 
indeed  appear  to  be  true,  but  the  basic  technique  has  not  changed  appreciably 
from  that  originally  described  in  1944.  This  is  particularly  significant  when 
the  availability  of  high-speed  computing  equipment  is  considered.  No  such 
capabilities  were  available  in  1944,  when  the  Bruceton  technique  was  develop¬ 
ed,  but  the  general  field  of  quantal  data  analysis  has  since  been  the  subject 
of  many  computer-aided  investigations.  22,28  Similar  investigations  of  the 
Bruceton  technique  have  been  somewh  it  limited,  and  that  is  one  of  the  reasons 
for  this  investigation. 

Probably  the  most  significant  problem  or  weak  point  of  the  Bruceton 
technique  is  the  requirement  to  have  an  estimate  of  the  mean  and  standard 
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deviation  prior  to  starting  the  tests.  The  mean  is  used  to  establish  the  initial 
test  level,  and  the  standard  deviation  is  used  to  establish  the  constant  incre¬ 
ment  by  which  test  levels  are  changed  to  obtain  subsequent  test  levels.  The 
accuracy  of  these  estimates  influences  the  results  depending  on  (1)  the  posi¬ 
tion  of  the  population  mean  relative  to  the  testing  levels  and  (2)  the  ratio  of  the 
test  increment,  d,  (i.  e. ,  the  estimated  standard  deviation)  to  the  population 
standard  deviation,  cr. 

From  his  investigations  of  the  Bruceton  technique,  Hampton21  concluded 
that  the  correlation  between  the  estimated  standard  deviation,  s,  and  the 
population  standard  deviation,  a,  was  poor  for  sample  sizeB  of  25.  This  fact 
has  been  substantiated  by  others  and  must  be  considered  in  any  evaluations 
of  Bruceton  data. 

There  are  other  more  subtle  points  made  by  Hampton  from  his  investi¬ 
gations,  but  these  are  considered  insignificant  so  far  as  this  particular  paper 
is  concerned.  The  other  conclusions  discussed  above  are  considered  more 
pertinent  and  were  used  during  this  investigation. 
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CHAPTER  II 


DESIGN  AND  DEVELOPMENT 
OF  A  SENSITIVITY  TEST  SIMULATION  PROGRAM 


1.  General  Philosophy 

The  use  of  a  digital  computer  simulation  program  with  a  simple  Monte 
Carlo  technique  to  generate  artificial  test  results  was  selected  as  the  only 
practical  means  of  obtaining  the  desired  information.  The  ideal  way  would  be 
to  test  actual  hardware  of  the  type  being  considered  and  uBe  these  results  in 
conjunction  with  further  analytical  work.  Since  this  approach  is  impractical 
from  the  standpoint  of  time  and  cost,  the  simulation  approach  was  selected 
as  the  most  practical  alternate.  It  was  possible,  however,  to  make  use  of 
results  available  from  limited  sensitivity  tests  of  appropriate  test  hardware  in 
establishing  certain  conditions  required  for  the  simulation  program. 

In  considering  the  total  simulation  effort  three  phases  were  planned. 
The  first  was  a  comparison/ evaluation  phase  in  which  the  two  techniques  were 
used  to  analyze  the  same  data  under  closely  controlled  conditions.  This 
permitted  a  direct  comparison  of  the  two  techniques  and  provided  results  for  a 
detailed  evaluation  of  each.  The  results  from  this  phase  were  also  used  to 
identify  any  weaknesses  in  technique  capability  and  to  guide  subsequent 
attempts  at  improvement.  The  next  phase  of  simulation  consisted  of  attempts 


to  improve  the  two  techniques  by  modification  of  the  earlier  programs.  These 
modifications  were  based  on  the  demonstrated  weaknesses  and  were  guided  by 
statistical  approaches  revealed  by  literature  research  in  the  field  of  sensitivity 
testing  and  quantal  data  analysis.  The  last  phase  consisted  of  evaluating  the 
final  version  of  the  best  technique.  The  input  data  for  this  phase  were  the 
same  as  the  initial  simulation,  permitting  a  direct  comparison  and  demonstra¬ 
tion  of  any  improvement. 

In  designing  the  simulation  program  it  was  decided  that  all  conditions 
and  inputs  would  be  held  as  closely  as  possible  to  practical,  real-world  condi¬ 
tions.  This  was  done  to  prevent  getting  results  which  might  be  good  in  an  ideal 
sense  but  would  be  impractical  for  implementation  in  the  real-world 
environment. 

For  assistance  in  following  the  development  of  the  simulation  program, 
a  glossary  is  presented  on  page  124  and  brief  descriptions  of  the  Bruceton  and 
Missile  techniques  are  presented  in  Appendixes  I  and  II,  respectively.  For 
more  detailed  information  reference  should  be  made  to  Princeton  Statistical 
Research  Group14  and  Dixon  and  Mood15  for  the  Bruceton  technique  and  Langlie 17 
for  the  Missile  technique.  The  simulation  was  programmed  on  an  IBM  7094 
computer  in  FORTRAN  IV  computer  language.  The  computer  program  listing 
is  presented  in  Appendix  III. 

Basically,  the  simulation  program  was  designed  to  generate  a  sample 
of  "test  hardware, "  as  represented  by  a  set  or  sample  of  appropriate  random 
numbers.  The  "test  item"  was  then  "tested"  according  to  the  Bruceton  and 
then  the  Missile  technique.  This  procedure  was  continued  until  the  complete 
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sample  of  "hardware"  was  tested.  The  mean  and  standard  deviation  was  then 
computed  according  to  the  respective  techniques  and  recorded.  The  sample 
mean  and  standard  deviation  were  also  computed  in  the  usual  manner  for 
Normally  distributed  data  and  recorded  for  comparison.  The  required  number 
of  samples  was  generated,  tested,  and  analyzed  in  this  manner,  and  then  the 
standard  error  of  all  the  sample  estimates  was  calculated.  These  standard 
errors  were  used  for  final  evaluation  of  the  techniques.  Additionally,  correla¬ 
tion  coefficients  between  the  Bruceton  and  Normal  and  between  the  Missile 
and  Normal  standard  deviation  estimates  were  calculated  and  recorded.  This 
procedure  was  followed,  in  general,  for  all  simulation  work. 

The  test  conditions  for  the  simulation  work  were  determined  based  on 
the  range  of  sample  sizes  to  be  investigated  and  on  actual  results  of  sensitivity 
tests  of  missile  component  hardware.  The  test  conditions  selected  are  shown 
in  Table  1,  and  the  test  data  used  in  determining  the  conditions  are  in  Table  2. 


Table  1.  Simulated  Test  Conditions 


Sample  Sizes 

15 

35 

55 

Population  No.  1 

T.  C.  *  No.  1 

T.C.  No.  4 

T.C.  No.  5 

M  =  100 

100 

100 

100 

CD 

c 

o 

o  =  0.  02 

Samples 

Samp’es 

Samples 

43 

3 

Population  No.  2 

T.C.  No.  2 

T.C.  No.  o 

T.C.  No.  8 

a 

o 

ft 

ix  -  1.  00 

100 

100 

100 

<0 

a  =  0.  09 

Samples 

Samples 

Samples 

a 

S 

$ 

Population  No.  3 

T.C.  No.  3 

T.C.  No.  7 

T.C.  No.  9 

n  =  1.00 

100 

100 

100 

o  =  0.  26 

Samples 

Samples 

Samples 

*  T.  C.  =  Test  condition 
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Table  2.  Missile  Component  Test  Data 


Missile 

Component 

High 

Temperature 

(°F) 

Low 

Temperature 
(°  F) 

Vibration 

(r2/Hz) 

Mechanical 

Shock 

_ tel _ 

X 

s 

X 

8 

X 

8 

X 

8 

Thermal  battery 

208.6 

15.  14 

-104.9 

7.82 

742 

0.  171* 

No.  1 

551 

0. 112* 

Thermal  battery 

199.5 

20.4 

-133.9 

7.49 

No.  2 

345.9 

6.  01 

Infrared  source 

271.7 

10.33 

-125.3 

4.5 

0.228 

0.  1095* 

No.  1 

Infrared  source 

0.300 

0.  9747* 

No.  2 

0.310 

0.7063* 

0.  160 

0.7193* 

2.  Establishing  Starting  Conditions 

After  the  simulation  test  conditions  were  established,  the  next  step  was 
to  program  the  two  techniques  for  the  computer.  For  the  Bruceton  technique 
it  is  necessary  to  have  preliminary  estimates  of  the  mean  and  the  standard 
deviation  in  order  to  determine  the  initial  test  level  and  the  constant  increment 
by  which  subsequent  test  levels  should  be  changed.  The  decision  to  be  made 
is  to  what  accuracy  could  the  mean  and  standard  deviation  be  estimated.  Since 


*In  terms  of  natural  logarithms. 


these  estimates  would  ordinarily  be  based  on  similar  data  from  other  test 
programs,  it  was  decided  to  use  the  data  in  Table  2  for  this  purpose.  A  simple 
statistical  analysis  of  these  data  was  performed  which  was  considered  to 
represent  that  which  would  be  done  under  "real-world"  conditions.  The 
"estimates"  thus  derived  as  inputs  are  shown  below. 


Population  No. 

Estimated  n 

Estimated  0 

1  (1,  0.02) 

1.07 

0.  035 

2  (1,  0.09) 

1.07 

0. 135 

3  (1,  0.26) 

1,07 

0.  390 

The  Bruceton  technique  estimate  of  the  standard  deviation,  s,  is  cal¬ 
culated  by  first  computing  a  value  of  the  expression  (Appendix  I) 

M  =  (2  i2  n^/ N  -  ( 2  i  n^N )2  . 

The  value  of  M  is  then  used  to  enter  Table  3  or  Figures  1  and  2  for  a  value  of 
S.  The  value  of  s  is  now  determined  from 

s  =  D  S, 

where  D  is  the  test  level  increment. 

For  values  of  M  greater  than  approximately  0.  325  the  graph  used  is 
linear  (Figure  1).  For  values  of  M  less  than  0.  325,  however,  a  family  of  four 
curves  must  be  considered  (Figure  2).  The  curve  used  is  selected  based  on 
the  relative  location  of  the  estimated  mean  to  one  of  the  test  levels;  i.  e. ,  if 
the  mean  were  located  half-way  between  two  test  levels,  one  specific  curve 
would  be  used.  Since  only  four  curves  are  presented,  interpolation  between 


them  is  required. 


Table  3.  Table  of  s  for  Obtaining  the  Sample  Standard  Deviation 
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Figure  1.  Curves  for  Estimating  the  Standard  Deviation 


Figure  2.  Curves  for  Estimating  tho  Standard  Deviation  (M  <0.  40) 
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To  find  exact  mathematical  functions  for  these  four  graphs  and  a  tech¬ 
nique  for  interpolating  between  them,  all  suitable  for  the  computer,  presented 
a  formidable,  if  not  impossible,  task,  and  an  alternate  procedure  was 
necessary.  For  values  of  M  greater  than  0. 325  an  expression  for  the  linear 
portion  of  the  graph  is  used  as  follows  *: 

s  =  D  S, 

where  S  =  1. 620  (M  +  0.  029) .  Again,  this  solution  is  only  good  when  M  is 
greater  than  0.  S25. 

For  values  of  M  less  than  0.  325  a  different  method  was  used  to  compute 
both  the  estimated  m^an,  xT,  and  the  estimated  standard  deviation,  s.  This 
method  is  described  in  Appendix  IV  by  Dixcn  and  Mood,  ®  and,  while  not 
specifically  intended  for  use  for  the  reasons  given  here,  was  evaluated  and 
found  to  be  acceptable.  The  method  provides  simultaneous  solutions  of  the  two 
maximum  likelihood  equations  by  iteration.  The  iteration  procedure  was  set  up 
and  checked  out  to  obtain  solutions  to  an  accuracy  of  ±0. 0001. 

There  is  only  one  initial  condition  to  be  set  for  the  Missile  technique, 
the  test  interval.  The  test  interval  is  described  as  an  interval  of  the  test 
environment  or  stimulus  large  enough  to  contain  all  values  of  the  critical 
responses  of  the  test  items.  To  obtain  realistic  values  for  this  interval  the 
test  data  of  Table  2  were  again  analyzed,  and  the  results  were: 

Population  No.  Test  Interval 

1  (1.0,0.02)  0.364  to  2. 20 

2  (1.0,0.09)  0.364  to  %.  20 

3  (1.0,0.26)  0.000  to  2. 63 
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The  input  conditions  for  the  simulation  program  are  summarized  in 
Table  4  for  the  initial  nine  test  conditions  shown  in  Table  1.  The  last  three 
items  listed  under  "Program  Input"  are  concerned  with  the  Bruceton  iterative 
solution  and  random  number  generation.  These  inputs  wil  be  discussed  sub¬ 
sequently  in  another  section  of  this  document. 

Up  to  this  point  in  the  simulation,  efforts  have  been  described  for 
generating  the  artificial  test  items  and  testing  these  items  using  the  Bruceton 
and  Missile  techniques.  At  this  point  the  simulation  program  was  satisfactorily 
designed  to  accomplish  this,  and  subsequent  programming  for  computations 
necessary  in  the  evaluation  of  the  results  were  formulated.  Since  the  basic 
objective  was  to  compare  and  evaluate  the  two  techniques,  a  basis  for  compari¬ 
son  was  necessary. 

Each  technique  estimates  the  mean  and  standard  deviation  using  the 
quantal  responses.  Since  the  actual  values  of  the  critical  responses  (i.e. , 
the  RNN)  are  available,  it  is  possible  to  estimate  the  mean  and  standard 
deviation  of  the  samples  using  this  information  in  the  standard  manner  (i.e. , 
using  the  equations  for  continuous,  Normally  distributed  data).  It  can  be 
shown  that  the  sample  estimates  using  the  Normal  equations  are  the  best 
obtainable,  and  hence  could  be  used  as  a  basis  for  comparing  the  other  esti¬ 
mates.  Thus  the  Bruceton  and  Missile  estimates  can  only  approach  the  Normal 
estimates  in  accuracy  and  repeatability.  Any  comparison  of  estimates  must 
consider  the  magnitude  by  which  the  estimate  differs  from  the  true  value  as 
well  as  the  repeatability  of  the  estimate.  The  means  of  the  estimated  means, 

X— ,  and  the  estimated  standard  deviation,  X  ,  should  thus  be  used.  Also,  the 
x  s 
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Table  4.  Simulation  Program  Computer  Inputs 


Program 

Test  Conditions 

Input 

1 

2 

3 

4 

5 

6 

7 

8 

9 

PXB 

(population  mean) 

1.00 

1.00 

1.  00 

1.00 

1.  00 

1.  00 

1.  00 

1.  00 

1.  00 

PS 

(population  stindard 
deviation ) 

0.02 

0.09 

0.  26 

0.02 

0.  02 

0.09 

0.  26 

0.09 

0.  26 

H  (initial  test 
level  —  Eruceion) 

1.07 

1.  07 

1.07 

1.07 

1.07 

1.07 

1.  07 

1.07 

1.  07 

DELTA  (test  level 
increment  —  Bruceton) 

0.030 

0.  135 

0.  390 

0.030 

0.  030 

0.  135 

0.  390 

0. 135 

0.390 

NS  (sample  size) 

15 

15 

15 

35 

55 

35 

35 

55 

55 

NO  (number  of 
samples ) 

100 

100 

100 

100 

100 

100 

100 

100 

100 

BETA  (standard  devia- 
tion  bias  correction  — 
Missile) 

0.762 

0.762 

0.762 

0.865 

0.  875 

0.  865 

0.  865 

0.  875 

0.875 

ULIM  (test  interval 
upper  limit  — 

Missile) 

2.20 

2.20 

2.63 

?  20 

2.20 

2.20 

2.63 

2.20 

2.63 

LLIf!  (test  interval 
lower  limit  — 

Missile) 

0.264 

0.  364 

0.  0 

0.364 

0.  364 

0.  364 

0.0 

0.  364 

0.0 

XMULT  'x~increment 
for  Bruceton  iterative 
pr  jcess ) 

0.05 

0.  20 

0.  40 

0.  05 

0.  05 

0.  10 

0.20 

0.  05 

0.  10 

SMULT  (s  increment 
for  Bruceton  iterative 
process) 

0.  25 

0.  33 

0.  50 

0.20 

0.  15 

0.  25 

0.  35 

0.20 

0.  25 

MI.T 

18974 

19847 

19847 

18974 

18974 

19847 

19847 

29874 

29874 

(random  number 
ger.erato  r) 

35261 

53021 

53623 

35263 

35265 

53625 

T3627 

53621 

53625 
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'standard  deviation  of  the  estimated  means,  S_,  and  the  estimated  standard 

x 

deviations,  S  ,  should  be  used  to  evaluate  repeatability, 
s 

Therefore,  in  addition  to  the  sample  means  and  standard  deviations 
estimated  by  the  Normal,  Bruceton,  and  Missile  techniques  for  each  sample 
of  test  items,  the  means  of  the  estimated  means  and  standard  deviations  from 
the  100  different  samples  as  well  as  the  standard  deviations  of  the  data  were 
computed  for  each  analysis  technique. 

It  was  also  an  objective  of  this  simulation  program  to  investigate  the 
degree  of  correlation  between  the  individual  sample  Bruceton  and  Missile 
estimates  of  the  standard  deviation  with  the  corresponding  Normal  estimates. 
The  correlation  between  the  sample  Bruceton  mean  estimates  was  reported  by 
Hampton21  to  be  very  good,  i.  e. ,  closely  and  positively  correlated  with  the 
calculated  coefficient  of  correlation  approaching  a  value  of  +  1.  0.  Therefore, 
no  further  investigation  of  mean  correlation  was  necessary.  The  coefficient  of 
correlation  of  the  standard  deviations  for  the  100  samples  from  each  test 
condition  was  calculated  by  the  formula  given  by  Hoel. 24 

Checkout  of  the  computer  simulation  program  was  accomplished  with 
two  objectives  in  mind.  First  of  all,  it  was  necessary  to  see  that  the  computer 
had  been  programmed  properly  to  accomplish  the  desired  calculations  in 
correct  sequence  and  to  see  that  the  program  logic  was  operating  as  intended. 
Second,  if  the  calculations  and  program  logic  were  correct,  it  was  necessary 
to  see  that  all  operations  on  the  computer  were  being  accomplished  as  effi¬ 
ciently  as  reasonably  possible.  This  was  done  to  reduce  the  cost  of  conducting 
the  program  and  was  aimed  prim  reducing  the  computer  running  time. 
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i  The  checkout  was  accomplished  by  running  the  simulation  through  a 

small  number  of  small  sample  size  tests.  The  computer  was  programmed  to 
print  out  the  results  of  significant  intermediate  steps  which  would  not  ordi¬ 
narily  be  required.  With  this  information  it  was  possible  to  follow  the  simu¬ 
lation  step  by  step  and  check  the  results  by  manual  computations  on  a  desk 
calculator. 

These  initial  efforts  did  indicate  excessive  computer  run  time,  and 
certain  changes  were  necessary.  The  most  significant  of  these  changes  was 
concerned  with  the  Bruceton  iteration  technique  described  earlier  (Appendix 
IV).  Analysis  of  the  test  results  was  requiring  too  many  iterations  for  con¬ 
vergence  of  the  solutions.  The  iterative  procedure  used  by  the  Bruceton 
technique  requires  trial  solutions  on  both  sides  (positive  and  negative)  of  zero 
in  order  to  interpolate  for  the  solution  at  zero  (the  maximum  likelihood  value). 
The  computer  logic  required  is  to  first  determine  whether  the  initial  trial 
solution  is  positive  (or  negative)  and  then  to  increment  this  trial  value  by  such 
an  amount  to  get  a  solution  with  the  opposite  sign.  This  process  is  repeated 
until  the  absolute  magnitude  is  sufficiently  small  to  permit  accurate  solutions 
at  zero  from  the  linear  interpolation. 

The  logic  originally  designed  into  the  computer  program  required  that 
the  initial  values  of"x  and  s  (obtained  by  the  standard  Bruceton  calculations) 
be  incremented  by  an  amount  equal  to  the  a  priori  estimates  of  x"  and  s,  i.  e. , 

1. 07  IT  and  1. 5  s.  (Initial  conditions  have  been  discussed  earlier. )  After 
evaluating  the  initial  runs  with  this  logic  it  was  concluded  that  these  increments 
were  too  large. 
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In  determining  the  size  of  the  required  increment  two  conflicting  con¬ 


siderations  are  present.  A  large  increment  is  desired  in  order  to  get  a  sign 
change,  but  at  the  same  time  a  smaller  increment  is  desired  to  get  more 
accurate  results.  As  a  compromise  the  following  reasoning  was  used.  It  is 
known  that  the  standard  error  of  estimating  a  is  a  direct  function  of  si iT  (where 
n  is  the  sample  size).  By  using  s  at  n  =  15  as  the  base,  the  ratio  of  '«/n'at  the 
different  sample  sizes  was  obtained.  This,  when  multiplied  by  the  increment 
at  n  =  15,  should  give  similar  increments  for  the  larger  sample  sizes.  The 
initial  increments  of  s  for  the  three  values  of  a  were  determined  based  on 
analysis  of  the  preliminary  runs  as  25  percent  of  s  for  <x  =  0.  02,  33  percent 
for  a=0.  09,  and  50  percent  for  a  =  0. 26.  These  percentages  are  essentially 
estimates  of  the  maximum  error  anticipated  in  the  Bruceton  estimates  of  the 
population  standard  deviation.  Increments  for  x  were  calculated  in  a  similar 
manner.  The  above  calculations  are  summarized  in  Table  5. 


Table  5.  As  and  Ax  Calculations 


|  As  Calculations 

n 

Standard 

Error  Ratio 

Increment 
(As)  @o  =  0.  02 

@(7=  0.  09 

@<J  —  0.26 

15 

1  (base) 

0.25 

0.  33 

0.  50 

35 

0.  67 

0.20  (0.67)  0.25 

0.  25 

0.  35 

55 

0.53 

0.  15  (0.53)  0.25 

0.20 

0.  25 

Ax  Calculations 

n 

Standard 
Error  Ratio 

Increment 
(Ax)  @<7=  0.02 

@a=  0.  09 

@a  =  0.26 

15 

1 

0.  05 

0.20 

0.40 

Table  5.  As  and  Ax  Calculations  (Concluded) 


Ax  Calculations 

n 

Standard 

Error  Ratio 

Increment 
(Ax)  @c r  =  0.  02 

@(T  —  0.09 

@<7  =  0.  26 

35 

0.428 

0.  05 

0.  10 

0.20 

55 

0.275 

0.05 

0.  05 

0. 10  1 

The  increments  in  Table  5  were  programmed  into  the  computer  as 
initial  inputs,  SMULT  (s  multiplier)  and  XMULT  (x  multiplier) .  Checkout 
runs  with  these  inputs  provided  satisfactory  results  and  this  approach  was 
made  a  permanent  part  of  the  simulation  program. 


3.  Summary  of  Computer  Simulation  Program 

With  the  required  changes  finalized  and  checked  out  the  computer  simu¬ 
lation  program  design  was  complete.  It  consisted  of  a  main  computer  routine 
and  the  subroutines  summarized  below.  The  complete  program  is  presented 
in  Appendix  III,  and  is  structured  as  shown  in  the  diagram  below. 

Main  Program  Routine 

Bruceton  Technique  Subroutine  Missile  Technique  Subroutine 


i  (BRUCMf) 

^-Failure  Level  Analysis  Subroutine 
(CHEK) 


A(MISSMT) 

^-Integration  Subroutine  (IGRAT) 


-Bruceton  Iteration  Subroutine 
4  (INTERP) 

' — Interpolation  Subroutine  (ITR) 


l— Solution  of  Simultaneous 

Equation  Subroutine  (SESOMI) 


The  main  program  routine  accepts  the  test  condition  inputs,  generates 


the  random  Normal  numbers,  and  calculates  the  overall  statistical  param¬ 
eters  using  the  Normal,  Bruceton,  and  Missile  estimates.  The  Bruceton 
technique  subroutine  (BRUCMT)  accepts  the  random  Normal  numbers  from 
the  main  routine,  generates  test  levels,  accomplishes  the  tests,  tabulates 
results,  and  computes  estimates  of  p  and  a  which  are  returned  to  the  main  pro¬ 
gram  routine.  The  Missile  technique  subroutine  (MISSMT)  operates  in  a 
similar  manner. 

The  Failure  Level  Analysis  subroutine  (CHEK)  was  used  to  analyze  the 
failure/ success/ test- level  data  and  compute  certain  parameters  from  these 
data  required  for  the  Bruceton  estimates.  The  Bruceton  Iteration  subroutine 
(INTERP)  was  used  where  the  values  of  M  were  less  than  0.  325  and  required 
the  iteration  procedure  for  estimating.  The  Interpolation  subroutine  (ITR) 
was  used  for  interpolating  between  values  in  two  tables  used  in  the  Bruceton 
iteration  procedure. 

The  Integration  subroutine  (IGRAT)  was  used  in  the  Missile  technique 
to  integrate  the  expression 


—oo 


SESOMI  is  a  subroutine  used  in  the  Missile  technique  to  solve  systems  of 
simultaneous  equations.  n 
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CHAPTER  III 


COMPARISON  OF  THE  STANDARD  BRUCETON 
AND  MISSILE  TECHNIQUES 

The  first  use  of  the  simulation  program  was  to  compare  the  perfor¬ 
mance  of  the  two  basic  techniques  as  they  are  presently  used  and  described  in 
the  literature,  14,15,17  This  was  accomplished  by  running  the  test  conditions 
shown  in  Table  1.  The  results  of  this  particular  simulation  effort  were  used 
initially  to  determine  the  relative  performance  of  the  two  techniques  and  to 
identify  more  detailed  characteristics  of  their  performance.  The  results  also 
provided  the  primary  guidance  for  subsequent  efforts  described  in  Chapter  IV 
to  improve  the  two  techniques,  and  ultimately  to  define  restrictions  of  the 
techniques  (Chapter  V). 

Evaluation  of  the  simulation  results  was  accomplished  in  two  phases. 

The  first,  preliminary,  evaluation  was  accomplished  using  a  relatively  simple 
estimating  efficiency  approach  designed  to  provide  quick,  quantitative  answers 
to  guide  subsequent  activity.  The  second  phase,  or  final  analysis,  was  based  on 
standard  statistical  analysis  techniques,  and  only  those  conclusions  which  result 
from  the  statistical  analysis  are  considered  in  the  final  evaluation  of  the  project. 
The  detailed  statistical  analysis  is  presented  in  Appendix  V. 

In  developing  the  estimating  efficiency  approach  for  the  preliminary 


29 


evaluation  It  was  recognized  that  the  Normal  estimates  of  n  and  a  are  the  best 
available  and  could  be  used  as  a  basis  for  comparison  of  the  other  two  tech¬ 
niques.  Thus,  if  the  efficiencies  of  the  three  different  estimators  were  calcu¬ 
lated  on  the  same  basis,  the  Bruceton  and  Missile  efficiencies  could  be  com¬ 
pared  directly  to  see  which  was  better  and  the  Normal  efficiencies  used  as  a 
measure  of  the  degree  of  potential  improvement  possible  in  the  other  two. 

The  following  two  expressions  were  chosen  as  expressing  the  desired 
efficiency  characteristic: 

E-  =  ~  I  P  -  X-l  -  S-Wp 

where 

p  and  a  =  the  true  population  parameters  as  programmed  into  the  com¬ 
puter 

X— =  the  mean  of  the  means  from  the  100  samples  of  test  results 
x 

X  =  the  mean  of  the  standard  deviations  from  the  100  samples  of 
s 

test  results 

S— =  the  standard  deviation  of  the  means  estimated  from  the  100 
x 

samples 

S  =  the  standard  deviation  of  the  standard  deviations  estimated 
s 

from  the  100  samples. 

In  deriving  the  above  expressions  it  was  reasoned  that  the  accuracy  of 
any  estimator  is  measured  by  two  factors,  (1)  the  amount  by  which  the  esti¬ 
mate  differs  from  the  true  value  of  the  parameter  being  estimated  and  (2)  the 

repeatability  of  the  estimator. 
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These  two  factors  were  defined  as  the  displacement  and  deviation, 
respectively,  and  are  expressed  as 

Displacements  j  p  -  X—  |,  and  |  a  -  X  | 

X  8 

Deviation  =  S_  and  S  . 

x  s 

Since  the  ’'perfect"  estimator  would  have  values  of  zero  for  both  of  these 
factors,  the  efficiency  expressions  given  earlier  would  have  an  efficiency  of 
1.  0  for  the  perfect  estimator,  and  anything  less  than  perfect  would  have  a  value 
less  than  1.0.  It  is  recognized  that  the  expressions  are  not  efficiencies  in  the 
true  sense  of  the  word  since,  under  certain  conditions,  it  is  possible  to  calcu¬ 
late  negative  values.  It  is  not  felt  that  this  possibility  significantly  detracts 
from  its  use. 

Data  from  the  comparison  simulation  are  presented  in  Table  6.  These 

data  were  calculated  from  the  100  individual  sample  estimates  of  p  and  a  by 

each  of  the  three  techniques.  From  the  data  in  Table  6,  efficiencies  were 

computed  (Table  7)  and  graphs  plotted.  The  graphs  are  shown  as  Figure  3 

for  E_  and  Figure  4  for  E  .  The  efficiencies  E_and  E  are  the  means  of  the 
x  s  x  s 

efficiencies  obtained  for  the  individual  test  conditions  of  the  same  sample 
size,  or  population. 

A  review  of  Figures  3  and  4  result  in  the  following  observations: 

1.  All  the  Normal  estimates  are  better  than  the  corresponding  Bruce- 
ton  or  Missile  estimates.  This  verifies  the  statement  made  earlier 
that  the  Normal  estimates  are  the  best  possible. 
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Table  6.  Summary  Analysis  of  100  Sample  Estimates 


Test 

Conditions 

No.  (n  ,  c r,  N) 

Technique 

X_ 

X 

SiT 

X 

s 

S 

8 

1  (1.0,  0.02,  15) 

Normal 

Bruceton 

Missile 

1.00044 

0.99124 

1. 00406 

0. 00496 
0.01951 
0.01774 

0.  01965 

0.  01854 

0.  00445 

0.  00384 

0. 00728 

0.  01429 

2  (1.0,  0.09,  15) 

Normal 

Bruceton 

Missile 

0  99935 

0.  96131 

1.  00155 

0.  02086 

0.  08037 

0. 04309 

0.  08744 

0.  08332 

0.  07653 

0.  01567 

0.  03003 

0.  06176 

3  (1.0,  0.26,  15) 

Normal 

Bruceton 

Missile 

0.99410 

0.95598 

0.98708 

0. 06653 

0.26766 

0. 10306 

0.  25533 

0.  28946 

0.  22876 

0.  04683 

0. 07630 

0. 16474 

4  (1.0,  0.02,  35) 

Normal 

Bruceton 

Missile 

1.  00034 
0.98146 

1. 00005 

0.00361 

0.  01483 

0. 00796 

0.01961 

0. 02093 

0.  01559 

0.  00237 

0.  00532 

0.  01015 

5  (1.0,  0.02,  55) 

Normal 

Bruceton 

Missile 

1. 00024 
0.98240 
1.00021 

0. 00294 
0.01590 

0. 00522 

0.  01984 

0.  02015 

0. 02023 

0.  00191 

0. 00366 

0. 00677 

6  (1.0,  0.09,  35) 

Normal 

Bruceton 

Missile 

1.00009 

0,93108 

0.99814 

0.01544 

0.08667 

0.02341 

0.  08920 

0.  09032 

0.  08379 

0. 01020 

0.  02076 

0.  03209 

7  (1.0,  0.26,  35) 

Normal 

Bruceton 

Missile 

0. 99889 

0.92697 

0.99664 

0,04277 

0.31330 

0.06430 

0.  25828 

0.  30910 

0. 24926 

0.  03111 

0.  16804 

0.  09518 

8  (1.0,  0.09,  55) 

Normal 

Bruceton 

Missile 

0.99947 

0.94012 

0.99815 

0.  12460 
0.09557 

0. 02075 

0.  09037 

0. 09241 

0.  09151 

0. 00974 
0.01531 

0.  03210 

9  (1.0,  0.26,  55) 

Normal 

Bruceton 

Missile 

1.00591 

1.00920 

1.  00437 

0. 03656 
0.28431 
0.05123 

0. 25757 

0.  29013 

0.  26647 

0. 02252 

0.  04480 

0.  07416 

i 


Table  7.  Calculated  Efficiencies  of  Techniques 


0.97888  0.80824  0.96637  0.87118  0.53938  0.47988  0.89810  0.63738  0.60136 


Table  7.  Calculated  Efficiencies  of  Techniques  (Concluded) 


1 


Iw 

2 

0. 73464 

0. 55779 

2 

0.  47756 

0. 58356 

0.61225 

« 

0.  78402 

0.  69008 

Iw 

m 

0.  75707 

0.75441 

0. 55875 

z 

0.91710 

0.  88479 

z 

0.  88620 

0.  88649 

0.  88169 

1  ® 
Iw 

2 

0.65548 

0.42348 

2 

0. 30733 

0.45503 

0. 50957 

« 

0.77480 

0.63232 

i  ® 

Iw 

m 

0.68667 

0.72033 

0.  48996 

z 

0. 89599 

0.  85460 

z 

0. 84967 

0.85422 

0.  85989 

IX 

Iw 

L 

2 

0.97212 

0. 95923 

2 

0. 98835 

0.96916 

0.  92027 

« 

0.81167 

0. 82230 

E_ 

X 

PQ 

0. 96829 

0. 85663 

0.64198 

55 

0. 98379 

0.  97652 

* 

0. 99582 

0.  98332 

0.  94707 

* 

55 

All 

b 

0.02 

0.09 

0.26 
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Figure  4.  Standard  Deviation  Estimating  Efficiency  Versus 
Sample  Size  and  Standard  Deviation 


2.  The  Missile  estimates  of  /uare  better  in  all  instances  than  the 
Bruceton  estimates.  Further,  there  is  very  little  difference 
between  the  Missile  and  Normal  estimates,  indicating  very  little 
potential  for  improving  the  Missile  estimate  of  the  mean. 

3.  The  Bruceton  estimates  of  a  are  better  than  the  Missile  estimates 
except  for  the  population  of  M  =  1.0  and  a  =  0.  26,  specifically  for 
a  sample  size  of  35  items  (Table  7).  Estimates  of  a  from  the 

H=  1.  0  and  a  ~  0.26  population  with  sample  sizes  of  15  and  55  are 
both  more  efficient  than  for  a  sample  of  35. 

4.  Estimates  of  n  are  fairly  insensitive  to  different  sample  sizes  when 
samples  from  the  three  different  populations  are  considered.  This 
can  probably  be  explained  by  noting  the  decrease  in  efficiency  with 
increasing  cr,  and  reasoning  that  this  decrease  offsets  the  increased 
efficiency  expected  with  larger  sample  sizes. 

5.  The  Bruceton  estimates,  of  both  n  and  cr,  are  not  statistically  con¬ 

sistent,  whereas  the  others,  Missile  and  Normal,  are. 

Based  only  on  the  above  observations,  it  is  not  possible  to  conclude 
which  of  the  two  techniques  is  best  for  estimating  ju  and  cr,  the  basic  objective. 
To  do  this  requires  consideration  of  the  relative  "weights”  of  /j.  and  a  esti¬ 
mating  efficiencies  which  must  be  given  in  combining  them  into  an  overall  tech¬ 
nique  efficiency,  E.  To  establish  a  basis  for  combining  the  statistical  esti¬ 
mates  of  n  and  cr  it  was  reasoned  that  the  estimates  are  usually  used  to  define 
an  interval  in  which  the  true  population  parameter  will  lie.  This  interval  may 
be  of  varying  widths  (X  ±1S,  x'  ±2S,  etc. ),  as  desired,  with  a  "3-sigma" 
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interval  (i.e. ,  ±3S)  typical  for  aerospace  testing.  By  substituting  the  asso¬ 

ciated  efficiency  in  place  of  the  respective  parameter  in  the  interval  expression 


(since  the  interval  is  the  usual  ultimate  objective),  an  expression  for  overall 
technique  efficiency  is  possible;  i.  e. ,  F  =  ^E_  +  3  E^  /4.  This  is  a  weighted 
average  in  which  E  is  given  three  times  the  weight  of  E_.  Obviously  an  infinite 

S  X 

number  of  weight  combinations  are  possible,  although  the  one  shown  above  was 
used  predominately  throughout  this  project. 

By  using  the  above  expression,  the  overall  efficiency,  E,  for  each 
individual  test  condition  was  calculated,  and  from  these  values  mean  overall 
efficiencies,  F,  for  each  sample  size  and  population  were  calculated.  The 
individual  and  mean  overall  efficiencies  are  presented  in  Table  7  and  the  mean 
overall  efficiencies  are  shown  plotted  versus  sample  size  and  population  in 
Figure  5.  Finally,  all  the  overall  efficiencies  (i.e.  ,  for  all  sample  sizes  and 
populations)  were  averaged  for  each  technique.  The  overall  mean  efficiency 
thus  calculated  for  the  Missile  technique  was  0.  55779  and  for  the  Bruceton 


technique  was  0.  69009. 


Data  on  the  coefficient  of  correlation  are  presented  in  Table  8  and  shown 
plotted  in  Figure  6.  These  results  show  that  the  Bruceton  estimates  of  a, 
when  all^  the  data  are  considered,  are  only  slightly  better  correlated  with  the 
Normal  estimates  than  are  the  Missile  estimates  (TAUB  =  0. 27064  versus 
TAUM=  0.26100,  Table  8).  Further  review  of  the  data  indicates  that  the 
Bruceton  is  superior  to  the  Missile  at  fairly  small  values  of  a  (i.  e. ,  a 
=  0.  02  and  0.  09) ;  otherwise,  the  Missile  estimates  have  stronger  correlation. 
Thus,  the  correlation  data  indicate  that  the  Bruceton  technique  is  probably  equal 
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Figure  5.  Overall  Estimating  Efficiency  Versus 
Sample  Size  and  Standard  Deviation 
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Table  8.  Correlation  Coefficients 


Test 

Conditions 

Significant 
at  90-Percent 

Significant 
at  90-Percent 

No.  (H,  <x,  N) 

TAUB* 

Confidence 

TAUM** 

Confidence 

1  (1.0,  0.02,  15) 

0.27107 

No 

0.22563 

No 

2  (1.0,  0.09,  15) 

0.38936 

Yes 

0. 19008 

No 

3  (1.0,  0.26,  15) 

0.05514 

No 

0. 36246 

Yes 

4  (1.0,  0.02,  35) 

0.2T362 

Yes 

0.28438 

Yes 

5  (1.0,  0.02,  55) 

0.43154 

Yes 

0.  26276 

Yes 

6  (1.0,  0.09,  35) 

0.29722 

Yes 

0.  15984 

No 

7  (1.0,  0.26,  35) 

0.  04650 

No 

0.34815 

Yes 

8  (1.0,  0.09,  55) 

0.44835 

Yes 

0.30630 

Yes 

9  (1.0,  0.26,  55) 

0.36763 

Yes 

0.25950 

Yes 

Significant 
at  90-Percent 

Significant 
at  90-Percent 

N 

TAUB 

Confidence 

TAUM 

Confidence 

15 

0.23852 

No 

0.25939 

No 

35 

0. 20578 

No 

0.26412 

Yes 

55 

0.36763 

Yes 

0.25950 

Yes 

All 

0.27064 

Yes 

0.26100 

Yes 

Significant 
at  90-Percent 

Significant 
at  90-Percent 

a 

TAUB 

Confidence 

TAUM 

Confidence 

0.  02 

0.32541 

Yes  ! 

0.25759 

Yes 

0.  09 

0. 37831 

Yes 

0.21874 

No 

0.26 

0.  10821 

No 

0.  30668 

Yes 

*  TAUB  =  correlation  coefficient  of  Bruceton  estimates 


**TAUM  =  correlation  coefficient  of  Missile  estimates. 
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Figure  6.  Correlation  Coefficients  of  Standard  Deviation 
Estimates  Versus  Sample  Size  and  Standard  Deviation 
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to  the  Missile  in  the  degree  of  correlation  between  estimates  of  a  by  the  Normal 
technique.  The  column  in  Table  8  headed  "Significant  at  90- Percent  Confidence" 
indicates  those  correlation  coefficients  which  were  determined  to  be  statisti¬ 
cally  significant  as  described  in  Appendix  V  on  page  120.  Further  evaluation  of 
these  coefficients  is  presented  in  Chapter  V. 


CHAPTER  IV 


V 


TECHNIQUE  IMPROVEMENT 


The  primary  objective  of  the  comparison  simulations  described  in 
Chapter  III  was  to  determine  the  better  of  the  two  techniques.  Additionally, 
these  results  were  used  to  guide  subsequent  effort  toward  technique  improve¬ 
ment.  The  approach  taken  for  technique  improvement  was  to  concentrate  first 
on  improving  the  standard  deviation  estimates,  and  then  on  improving  the 
mean  estimates.  Technique  improvement  of  both  the  mean  and  standard 
deviation  estimates  simultaneously  was  not  attempted,  per  se.  In  addition  to 
the  many  attempts  made  at  improving  the  Bruceton  and  Missile  estimates  of 
H  and  a,  several  totally  new  techniques  were  developed  and  evaluated.  Only 
the  mere  pertinent  portion  of  the  Improvement  effort  will  be  described  here. 

In  evaluating  the  different  modified  techniques  the  efficiency  approach 
as  described  earlier  was  used.  More  specifically,  the  modifications  were 
checked  out  by  changing  the  simulation  program  as  required  and  running  a 
small  number  (5  to  15)  of  samples  at  certain  of  the  test  conditions  specified  in 
Table  1.  The  test  conditions  were  selected  to  permit  the  greatest  amount  of 
improvement.  For  instance,  if  an  improvement  in  Bruceton  standard  devia¬ 
tion  estimating  was  being  evaluated,  test  condition  No.  7  would  be  run  since 
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(Table  7 )  for  this  particular  test  condition  the  Bruceton  standard  deviation 
estimating  efficiency  was  minimum.  If  the  modification  being  evaluated 
produced  improvement,  it  was  further  evaluated  at  other  of  the  test  conditions 
by  running  more  samples  (usually  100). 

The  expression  "test  condition"  in  Chapter  III  had  two  implied  mean¬ 
ings.  First  it  specified  the  values  of  Mi  o,  and  N  (sample  size)  used  in  the 
simulation  program  (i.  e.  ,  test  condition  No.  1  implied  values  of  n  -  1.  0, 
a  =  0.  02,  and  N  =  15)  (Table  1).  Second,  "test  condition"  was  used  to  refer  to 
a  certain  specific  portion  of  the  simulation  effort;  i.  e. ,  test  condition  No.  1 
referred  to  the  100  tests  simulated  at  the  specified  conditions.  As  used  in  this 
Chapter  the  expression  test  condition  will  refer  only  to  the  specific  portions 
of  the  simulation  effort  described  i  Chapter  III.  Similarly  the  expression 
"re-test"  will  refer  to  simulation  effort  accomplished  subsequent  to  that 
described  in  Chapter  III.  This  distinction  is  desired  for  convenience  in 
distinguishing  between  the  results  of  simulation  work  described  in  this  chapter 
when  compared  with  the  results  of  work  described  in  the  preceding  chapter. 

The  first  attempt  at  technique  improvement  resulted  from  the  realiza¬ 
tion  that  the  Bruceton  technique  required  more  a  priori  information  than  did 
the  Missile,  and  it  was  decided  to  take  this  information  and  use  it  to  establish 
a  "tighter"  test  interval  and  different  "degenerate  solution"  logic  for  the 
Missile  technique. 

Degenerate  solutions  for  the  estimated  standard  deviation  (i.  e. ,  a 
<0.  0)  sometimes  result  from  the  Missile  technique  when  the  true  value  of  cr 
is  small.  Langlie17  states  that  when  degenerate  solutions  occur  the  actual  value 
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of  (7  is  small  and  thus  the  estimate  should  be  set  equal  to  zero.  This  logic  was 
followed  in  the  simulation.  It  was  reasoned,  however,  that  perhaps  the  rough 
estimate  of  a  used  for  the  Bruceton  might  be  a  better  estimate  for  the  degener¬ 
ate  cases.  Therefore,  this  was  programmed  into  the  computer  along  with 
logic  to  set  the  test  interval  limits  at  X  ±4S,  where  X  and  S  are  the  a  priori 
Bruceton  estimates.  These  changes  result  in  the  Missile  technique  using  the 
same  a  priori  information  as  the  Bruceton. 

Fifteen  samples  at  p  =  1.  00,  a  =  0.  02,  sample  size  15  were  run  with 
these  program  changes  as  re-test  No.  1  (RT  No.  1).  The  Missile  estim«ues 
from  this  run  are  presented  below  together  with  Missile  technique  estimates 
from  test  condition  No.  1  (TC  No.  1)  for  comparison. 

Re-Test  No.  1  Test  Condition  No.  1 

E  0.44806  0.24455 

E- 0.99276  0.97820 

x 

E  0.28650  0 

& 

All  criteria  increased  in  magnitude,  indicating  improvement  in  all  estimates. 

It  was  noted  that  RT  No.  1  had  only  47  percent  degenerate  solutions  as  com¬ 
pared  with  90  percent  for  the  Chapter  III  results.  This  reduction  is  apparently 
the  result  of  the  smaller  test  interval  used,  and  is  the  reason  for  the  improve¬ 
ment  in  estimates  of  p  and  a.  The  improvement  in  E  is  particularly  signifi- 
cant,  and  it  is  concluded  that  these  two  changes  should  be  adopted  for  the 
Missile  technique  whenever  possible.  These  two  changes  were  not,  however, 
adopted  for  further  simulation  work  described  in  this  report.  This  decision 
was  made  to  permit  a  more  valid  determination  of  improvement  of  subsequent 
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changes  in  the  basic  technique. 


1.  Improvement  in  Estimating  the  Standard  Deviation 

Efforts  to  improve  the  estimates  of  cr  were  based  primarily  on  prin¬ 
ciples  developed  by  Friedman. 25  Friedman  proved  that  minimum  variance 
estimates  of  cr  result  when  sensitivity  tests  are  conoucted  at  two  test  levels  of 
li  ±1.57  cr.  This  principle  was  investigated  thoroughly  by  several  different 
approaches,  with  no  practical,  favorable  results.  A  theoretical  improvement 
in  estimating  cr  was  demonstrated  using  this  principle,  however,  and  will  be 
described. 

This  approach  used  the  Friedman  principle  in  conjunction  with  the 
Missile  technique.  Logic  was  developed  to  cluster  the  Missile  test  levels 
around  the  values  of  X  ±KS  as  follows  : 

1.  Calculate  the  standard  Missile  test  level  (MTL). 

2.  If  MTL  s  X,  calculate  TL  =  MT-L-+  +-KS  . 

If  MTL  <  3T,  calculate  TL  =  MTL  ~-K$  . 

3.  Use  the  calculated  value  of  TL  as  the  test  level. 

This  logic  clustered  all  the  test  levels  within  ±15  percent  X  of  the 
desired  values  (X  ±1.  57  cr) . 

This  modified  Missile  technique  was  investigated  with  the  simulation 

program  at  various  values  of  X,  K,  and  S.  Only  when  X  was  set  at  1.  07  and 

KS  at  1.  6  a  was  improvement  in  E  demonstrated.  These  values  were  run  as  RT 

s 

No.  8  for  the  ^  =  1.  0,  a  =  0.  26,  N  =  35  condition,  and  the  results  are  shown 
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below  together  with  the  results  of  TC  No.  7  for  comparison. 

RT  No.  8  'IT  No.  7 

jl  0.80596  ii.  .i‘>376 

s 

The  results  show  a  rather  significant  improvement  in  E  .  It  is  not  only  better 

B 

than  the  standard  Missile  estimate  of  0.  59376,  but  also  approaches  the  Normal 

estimate  of  0.  88346.  There  was  also  a  slight  improvement  in  E_  (0.90200 

x 

versus  0.  89433) . 

Although  these  results  indicate  significant  improvement  in  E  ,  it  must 

8 

be  pointed  out  that  actual  population  values  of  p  and  a  were  used  in  establishing 
the  test  levels.  These  values  would  not  be  known  in  an  actual  testing  situation, 
only  rough  estimates.  For  this  reason  the  demonstrated  improvement  in  E 

8 

must  be  described  as  "theoretical.  " 

Other  approaches  at  improving  estimates  of  a  were  also  unsuccessful, 

€ 

and  it  was  concluded  that  the  Bruceton  estimate  of  a  is  the  best  available. 

t 


2.  Improvement  in  Estimating  the  Mean 

During  his  discussion  of  the  Missile  technique,  Langlie17  stated  that  the 
accuracy  of  the  estimates  of  the  standard  deviation  should  be  improved  with 
more  precise  estimates  of  <7  for  use  as  the  initial  value,  a0,  in  the  iterative 
solution  of  the  Missile  technique.  It  was  reason  id  that  Bruceton  estimates  of 
<t  would  be  very  good  as  initial  values  for  this  purpose.  To  accomplish  this, 
the  Bruceton  technique  must  be  used  to  conduct  the  test  and  obtain  estimates 
of  a,  which  would  then  be  used  by  the  Missile  technique  as  values  of  <r0  in  con¬ 
ducting  the  final  analysis. 
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The  necessary  changes  were  made  in  the  simulation  program  and  four 
simu'ation  runs  conducted  as  RT  No.  22-25  at  values  of  p,  a,  and  N  corres¬ 
ponding  to  TO  No.  1,  3,  2,  and  6,  respectively.  The  results  of  these  re-tests 
were  very  similar  and  only  the  results  of  RT  No.  22  (a  nine-sample  run)  will 
be  presented.  These  results  are  shown  in  Table  9. 

The  results  show  that  for  four  of  the  nine  tests,  the  Missile  iteration 
procedure  could  not  be  successfully  applied.  This  was  because  the  first  value 
of  p  calculated  by  the  procedure  was  negative,  and  the  computer  logic  was 
set  up  to  return  the  last,  non-negative  value  of  p.  The  values  of  the  estimated 
mean  and  standard  deviation  shown  in  Tabic  9  are  those  calculated  by  the 
Normal,  Bruceton,  and  Missile  techniques  for  each  sample  tested.  The 
Bruceton  estimates  were  used  as  initial  values  in  the  Missile  iterative  solu¬ 
tion  procedure,  and  for  those  samples  where  iteration  was  not  accomplished 
(i.e.  ,1=0),  the  Bruceton  and  Missile  estimates  are  identical.  Of  the  five 
samples  where  iteration  occurred,  only  one  (No.  5)  resulted  in  an  improved 
estimate  of  a  over  that  started  with  initially. 

As  stated  before,  RT  No.  25  was  run  at  p  =  1.  00,  a  =  0.  09,  and  N 
=  35,  one  of  the  poorer  conditions  for  making  Bruceton  estimates.  However, 
during  review  of  the  RT  No.  25  data  it  was  noted  that  Bruceton  estimates  of  p 
were  much  closer  to  the  Normal  estimates  whenever  M  ^  0.  325.  It  was 
further  recognized  that  the  Bruceton  simulation  contained  logic  which 
resulted  in  an  iterative  solution  whenever  M  ^  0.  325.  The  reasons  for  this 
logic  were  given  in  Chapter  II.  Since  both  iterative  solutions  (iterative 
Bruceton  and  Missile)  solve  the  maximum  likelihood  equations,  it  was  at  first 
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Table  9.  Results  of  Re- Test  No.  22 


\ 


Sample 

No. 

Technique 

Estimated 

Mean 

Estimated 

Standard 

Deviation 

I* 

M 

1 

Normal 

Bruceton 

Missile 

1.00010 

0.96500 

0. 96500 

0.  02109 

0.  03381 

0.  03381 

0 

0.  66667 

2 

Normal 

Bruceton 

Missile 

0.99231 

0.  98002 

0.98000 

0.01546 

0.01721 

0.02701 

13 

0.  25000 

3 

Normal 

Bruceton 

Missile 

I  0.99535 
i  0. 98953 
0.98449 

0.01450 

0.01083 

0.  00609 

13 

0.  13889 

4 

Normal 

Bruceton 

Missile 

1.00261 

0. 97000 

0.  97000 

0.01912 

0.02436 

0.  02436 

0 

0.47222 

5 

Normal 

Bruceton 

Missile 

0.  99356 

0.99501 

0.99500 

0.  02593 

0.01944 

0.02032 

4 

0.28571 

6 

Normal 

Bruceton 

Missile 

1. 00896 

1.01507 

1.01101 

0.01810 

0.01568 

0. 00735 

11 

0.22222 

7 

Normal 

Bruceton 

Missile 

0.99829 

0.  96500 
0.96500 

0.01362 

0.01761 

0.01761 

0 

0.33333 

8 

Normal 

Bruceton 

Missile 

0.99233 

0.96929 

0.96929 

0.  02285 
0.02125 

0.02125 

0 

0.40816 

9 

Normal 

Bruceton 

Missile 

0.99625 
i. 00497 

1. 00404 

0.02019 

0.01563 

0. 00909 

1 

0. 22222 

*  I  =  number  of  iterations  accomplished  in  the  modified  Missile 
technique. 
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thought  that  the  two  procedures  were  the  same  with  only  some  variations 
between  them.  Further  consideration  ruled  this  out  since  iteration  is  used  with 
the  Bruceton  technique  only  for  about  50  percent  of  the  time  (i.  e. ,  only  when 
M  ^  0.  325) ,  but  it  is  used  with  the  Missile  technique  all  the  time.  Also,  the 
Bruceton  iterative  procedure  is  being  used  only  because  of  the  difficulty  of 
programming  the  standard  technique  for  the  M  £  0.  325  situation. 

To  obtain  further  evaluation  of  iterative  Bruceton  solutions,  the  original 
nine  100-sample  runs  (Chapter  III)  were  reviewed.  Although  no  particularly 
significant  information  was  obtained  from  this  review,  it  was  noted,  at  least 
for  the  TC  No.  7  data,  that  for  those  samples  where  two  iterative  solutions 
were  obtained  the  answers  were  very  similar.  For  the  samples  where  only  one 
iterative  solution  was  obtained  (i.  e.  ,  M  >  0.  325  and  thus  only  the  Missile 
estimate  was  an  iterative  solution),  the  iterative  solution  was  the  most 
accurate.  Therefore,  it  appeared  that  the  iterative  Bruceton  estimates  of  n 
were  as  good  as  the  Missile  estimates  and  that  both  approached  the  Normal 
estimates  in  accuracy.  Obviously,  data  were  needed  which  allowed  evaluation 
of  the  iterative  Bruceton  solutions  for  the  situation  where  M  >  0.  325. 

The  additional  simulation  was  required  at  the  larger  values  of  M,  since, 
evidently,  the  noniterative  or  standard  Bruceton  estimates  produced  greater 
inaccuracies  at  these  values.  Further  review  of  the  nine  100- sample  runs 
indicated  that  TC  No.  7  would  be  satisfactory.  Thus  RT  No.  26  was  run  at 
M  =  1.0,  <7“  0.26,  and  N=  35,  providing  Normal,  standard  Bruceton,  and 
Missile  estimates  of  n  and  a,  as  well  as  estimates  by  the  iterative  Bruceton 
technique  of  all  samples  regardless  of  the  value  of  M.  The  results  of  RT  No. 
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26  are  presented  in  Table  10. 


Table  10.  Results  of  Re- Test  No.  26 


Bruceton 

Iterative 

Missile 

Normal 

Technique 

Bruceton 

Technique 

Technique 

E_ 

X 

0.62461 

0.  92651 

0.  93360 

0.  95241 

E 

8 

0 

0 

0.60000 

0. 84630 

It  is  seen  that,  as  before,  the  Missile  estimates  of  u  are  better  than 
the  Bruceton.  There  is  also  a  significant  improvement  of  the  iterative  Bruce- 
ton  over  the  standard  Bruceton.  No  conclusion  can  be  made  concerning  the 
estimates  of  u  other  than  to  say  that  the  Missile  estimates  are  better  than  the 
others  (excluding  the  Normal)  for  this  particular  test  condition.  This  was 
also  true  in  the  earlier  simulations. 

In  summary,  it  appeared  that  the  iterative  Bruceton  estimates  of  n 
were  about  as  accurate  as  the  Missile  estimates.  If  this  could  be  verified 
over  all  test  conditions,  then  an  improvement  in  overall  technique  could  be 
obtained  by  combining  the  iterative  Bruceton  estimates  of  ju  with  standard 
Bruceton  estimates  of  a. 

The  technique  combining  iterative  Bruceton  estimates  of  p  and  standard 
Bruceton  estimates  of  a  was  designated  the  Improved  Bruceton  technique.  To 
obtain  data  for  a  complete  evaluation  of  this  technique  it  was  necessary  to 
simulate  the  nine  test  conditions  as  before  (Table  1)  and  obtain  iterative 
Bruceton  estimates  of  /u.  The  standard  Bruceton  estimates  of  a  would  be  the 
same  as  those  obtained  earlier  during  the  comparison  simulations  of  Chapter 
III,  and  those  data  (Tables  6  and  7)  were  used  to  complete  the  evaluation  of  the 
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Improved  Bruceton  technique.  Thus,  eight  additional  100-sample  runs  were 
required  (the  ninth  having  already  been  run  as  RT  No.  26).  These  were  run 
as  RT  No.  27  and  28  and  RT  No.  31-36  at  values  of  n,  cr,  and  N  corresponding 
to  TC  No.  9,  3,  1,  2,  4,  5,  6,  and  8,  respectively. 

The  nine  re-tests  were  analyzed  as  described  previously  and  the 
results  are  presented  in  Table  11  and  plotted  ir.  Figure  7.  It  is  seen  that  the 
iterative  Bruceton  estimates  of  the  mean  are  very  good  over  all  sample  sizes 
and  standard  deviations,  varying  from  a  value  of  0.91486  for  the  0.  26  popula¬ 
tion  up  to  0.  99259  for  the  0.  02  population.  The  standard  deviation  estimates 
are  not  nearly  so  efficient,  varying  from  a  low  value  of  0.  10374  for  the  0.26 
population  up  to  a  value  of  0.  55270  for  the  0.  09  population.  Thus  the  iterative 
Bruceton  mean  estimates  are  much  better  than  the  standard  Bruceton  mean 
estimates  while  the  standard  deviation  estimates  are  not  as  good.  It  is  also 
noted  that  the  iterative  Bruceton  estimates  of  the  mean  are  more  consistent 
than  the  standard  Bruceton,  and  are  fairly  constant  over  the  conditions 
simulated. 

Based  on  these  results  the  final,  best  technique  should  be  as  described 
before,  the  standard  Bruceton  test  procedure  with  iterated  Bruceton  estimates 
of  the  mean,  and  standard  Bruceton  estimates  of  the  standard  deviation.  This 
will  be  referred  tc  as  the  Improved  Bruceton  technique. 

Thus,  while  the  attempts  at  technique  improvement  described  in  this 
chapter  were  not  totally  successful  in  that  no  improvement  in  standard  devia¬ 
tion  estimates  was  developed,  the  improvement  demonstrated  for  estimating 
the  mean  was  significant  and  represents  further  accomplishment  towards  the 
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Table  XI.  Summary  Analysis  and  Calculated  Efficiencies  of  the  Iterative  Bruceton  Estimates 


0.95679  0.38804  0.53121 


Figure  7.  Iterative  Bruceton  Technique  Estimating  Efficiencies 
Versus  Sample  Size  and  Standard  Deviation 


\ 

overall  project  objective--.  The  In, proved  firuceton  technique  Is  further 
analyzed  and  evaluated  In  the  next  chapter. 


CHAPTER  V 


FINAL  EVALUATION  AND  CONCLUSIONS 


Evaluation  of  the  Improved  Bruceton  technique  to  this  point  has  con¬ 
sisted  only  of  analysis  of  the  portion  concerned  with  estimating  the  mean.  It 
ri.mains  to  be  determined  how  well  the  overall  technique  survives  further 
evaluation.  In  this  chapter  simulation  data  from  Chapters  III  and  IV  will  be 
combined  so  that  the  evaluation  can  be  completed. 

The  data  presented  in  Table  11  and  Figure  7  relate  only  to  the  mean 
estimating  capability  of  the  Improved  Bruceton  technique.  To  complete  the 
overall  evaluation,  data  are  required  on  the  standard  deviation  estimating 
capability  also.  Since  the  standard  deviation  estimating  procedure  is  the  same 
as  that  of  the  standard  Bruceton  technique,  the  Bruceton  data  obtained  during 
the  comparison  simulations  described  in  Chapter  III  can  be  used.  These  data 
(Tables  6  and  7)  have  been  appropriately  combined  with  those  obtained  from 
the  iterative  Bruceton  simulations  of  Chapter  IV  (Table  11)  and  are  presented 
in  Table  12  and  Figures  8  through  10.  These  data  are  thus  the  same  as  those 
which  would  have  resulted  had  the  complete  Improved  Bruceton  technique  been 
simulated  and  the  original  nine  test  conditions  run.  The  final  evaluations  of 
the  technique  will  be  based  on  these  data. 
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Table  12.  Summary  Analysis  and  Calculated  Efficiencies  of  the  Improved  Bruceton  Estimates 


AU  0.95679  0.63232  0.71427 


Table  12.  Summary  Analysis  and  Calculated  Efficiencies  of  the 
Improved  Bruceton  Estimates  (Concluded) 


cr 

V 

E 

s 

E 

0.02 

0. 99259 

0.68667 

0.76315 

0.09 

0.97293 

0. 73033 

0. 78348 

0.26 

0.91486 

0.  48996 

0.59618 

Review  of  Figure  10  indicates  that,  based  on  efficiency  only,  the  Improved 
Bruceton  estimates  are  the  best  of  the  one-shot  techniques.  Statistical  analysis 
(Appendix  V)  of  these  results  does  not  completely  substantiate  this  conclusion. 
This  analysis  shows  that  both  the  Missile  and  Improved  Bruceton  techniques  are 
superior  to  the  Bruceton,  and  no  statistically  significant  difference  between  the 
Missile  and  Improved  Bruceton  techniques  was  shown  for  estimating  the  mean. 
The  Improvement  in  overall  performance  by  the  Improved  Bruceton  technique 
is  indicated  as  only  approximately  2.5  percent,  but  it  should  be  remembered 
that  in  calculating  the  overall  efficiencies  the  standard  deviation  efficiency  is 
given  three  times  more  weight  than  the  mean  efficiencies.  All  of  the  technique 
improvement  is  the  result  of  improvement  in  estimating  the  mean,  which  was 
actually  13  percent.  This  improvement  becomes  more  significant  for  testing 
items  which  have  only  a  small  amount  of  variation  in  strength  (i.e. ,  small  a 
as  compared  with  p).  In  this  situation,  errors  In  estimating  the  standard 
deviation  are  not  nearly  as  significant. 

Correlation  of  the  Improved  Bruceton  standard  deviation  estimates 
remains  the  same  as  for  the  Bruceton  estimates  discussed  before,  since  the 
estimates  are  the  same.  The  values  for  TC  No.  1,  3,  and  7  (Table  8)  indicate 
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efficiency, 


o  NORMAL  EFFICIENCIES 
£  BRUCETON  EFFICIENCIES 

0,2  M,SSILE  efficiencies 
©~®  IMPROVED  BRUCETON 
EFFICIENCIES 


SAMPLE  SIZE 


STANDARD  DEVIATION 


Figure  8.  Comparison  of  theMean  Estimating  Efficiency  of  the 

Four  Techniques 


EFFICIENCY, 


zero  correlation  for  estimates  of  a.  This  means  that  estimates  of  the  standard 


deviation  at  these  conditions  should  be  disregarded.  Test  condition  No.  3  and  7 
are  both  conditions  with  tests  from  the  0.  26  test  population  with  samples  of  the 
two  smaller  sizes.  Since  TC  No.  9  is  also  from  the  cr=  0.  26  population  but  at 
the  largest  sample  size,  it  is  concluded  that  smaller  size  is  causing  the  lower 
degree  of  correlation.  Thus,  in  order  for  the  a  estimates  to  have  a  reasonable 
degree  of  correlation,  the  minimum  sample  size  for  testing  hardware  with 
relatively  large  variation  in  strength  should  be  55  items. 

The  above  discussion  of  TC  No.  1,  3,  and  7  is  also  substantiated  from 

the  standpoint  of  estimating  efficiency.  The  values  of  E  for  TC  No.  1,  3,  and 

s 

7  are  generally  lower  than  the  others  (Table  12).  Thus,  of  the  nine  conditions 
investigated,  restrictions  on  sample  sizes  should  be  placed  on  four.  The 
restrictions,  in  effect,  are  that  sample  sizes  smaller  than  35  should  not  be 
used  for  estimating  a  of  any  population,  and  for  populations  with  relatively 
large  a  the  sample  size  should  be  increased  to  a  minimum  of  55.  These  same 
restrictions  apply  tc  the  Improved  Bruceton  technique. 

In  continuing  the  individual  test  condition  evaluation  further,  the  Table  7 
data  were  compared  with  the  Table  12  data.  The  Improved  Bruceton  technique 
efficiency  for  estimating  the  mean  is  greater  for  all  nine  conditions,  ranging 
from  a  minimum  improvement  of  1.  7  percent  at  TC  No.  1  to  a  maximum  of 
31.  3  percent  at  TC  No.  7.  Based  only  on  the  Table  7  data,  the  standard  Bruce¬ 
ton  estimates  of  the  mean  of  TC  No.  3,  7,  and  9  would  not  have  been  acceptable, 
and  the  estimates  of  TC  No.  2,  6,  and  8  would  be  marginal.  This  indicates 
that  the  standard  Bruceton  technique  probably  has  a  weakness  for  estimating  the 
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mean  of  any  hardware  which  has  relatively  large  variation  in  strength  (i.  e. , 
of  /i  —  0.09).  The  Improved  Bruceton  technique  completely  eliminates  this 
particular  weakness,  a  very  significant  improvement. 

So  far  as  the  Missile  technique  is  concerned  the  data  in  Table  7  reveal 
that  the  Missile  mean  estimator  is  more  efficient  than  the  standard  Bruceton, 
with  the  opposite  generally  true  for  the  standard  deviation.  This  is  substanti¬ 
ated  by  the  statistical  analysis  presented  in  Appendix  V.  Review  of  the  Missile 
correlation  coefficient  data  (Table  8)  shows  that  standard  deviation  estimates 
at  TC  No.  1,  2,  and  6  are  not  correlated  and  thus  should  be  disregarded.  These 
are  essentially  small  sample/ small  a  conditions  and  thus  a  minimum  sample 
size  of  35  should  probably  be  specified  and  increased  to  55  for  TC  No.  6. 

Thus,  of  the  nine  test  conditions  investigated,  four  (TC  No.  1-3,  and 
6)  have  been  restricted  for  use  with  the  Missile  technique,  and  also  four  (TC 
No.  1-3,  and  7)  for  the  standard  Bruceton  and  Improved  Bruceton  techniques. 

The  basic  objective  of  this  investigation  was  originally  stated  as  that  of 
providing  an  answer  to  the  question,  "Which  technique,  Bruceton  or  Missile,  is 
the  better  for  sensitivity  testing  of  one-shot  items  with  sample  sizes  ranging 
from  15  to  50  items?  "  It  was  also  planned  to  determine  whether  one  technique 
should  be  preferred  over  another  under  different  situations.  Finally,  efforts 
were  planned  for  improving  either  one  of  the  two  techniques  or  developing  a 
new,  improved  technique.  Investigations  have  been  completed  as  described 
previously  towards  all  these  objectives  with  varying  degrees  of  success. 

It  is  felt  that  the  question  as  to  which  of  the  two  techniques,  Bruceton  or 
Missile,  is  the  better  for  conducting  sensitivity  tests  was  satisfactorily 
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answered.  Based  on  the  analysis  of  variance  results  and  sign  tests  described 
in  Appendix  V,  it  must  be  concluded  that  between  the  standard  Missile  and 
Bruceton  test  techniques,  the  Missile  technique  is  the  better.  It  was  deter¬ 
mined  that  limitations  should  be  placed  on  the  use  of  both  techniques  as 
described  earlier. 

Improvement  was  demonstrated  for  the  Bruceton  technique.  An  iterative 
solution  is  proposed  for  calculating  the  estimates  of  the  mean.  These  solutions 
were  shown  to  be  significantly  better  than  those  provided  by  the  standard 
Bruceton  technique  and  equal  to  those  of  the  Missile  technique.  However,  since 
no  improvement  over  the  standard  Bruceton  estimates  for  a  was  developed,  the 
standard  Bruceton  estimate  must  be  used  with  the  limitation  that  for  estimating 
a,  minimum  sample  sizes  of  35  items  should  be  used  under  any  conditions,  and 
increased  to  55  for  situations  similar  to  TC  No.  6.  It  was  not  possible  to 
determine  any  statistically  significant  differences  between  the  Improved  Bruce¬ 
ton  and  Missile  techniques.  Mean  estimates  of  both  techniques  were  shown  to 
be  significantly  better  than  the  standard  Bruceton  estimates  (both  the  estimates, 
X_,  and  their  standard  deviations,  S_,  were  significantly  better) .  Analysis  of 

X  X 

the  standard  deviation  estimates  of  the  three  techniques  was  inconclusive.  The 
means  of  the  Missile  standard  deviation  ^  were  shown  to  be  better,  but  the 
standard  deviation  of  the  standard  deviation  estimates  ^3^  were  shown  to  oe 
larger  than  the  standard  Bruceton  (or  Improved  Bruceton)  estimates. 

Thus,  two  test  techniques  of  apparently  equal  capability  are  available 
for  small-sample  sensitivity  testing  of  one-shot  items.  Both,  however,  offer 
certain  advantages  under  different  situations.  The  Improved  Bruceton  technique 
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is  amenable  to  manual  computations ,  while  the  Missile  technique  requires  a 
computer  for  analysis  of  the  test  data.  On  the  other  hand,  the  Missile  tech¬ 
nique  requires  no  prior  estimates  of  n  and  a,  whereas  the  Bruceton  technique 
does.  Further,  if  such  prior  information  is  available  and  used  with  the  Missile 
technique,  some  improvement  in  the  estimates  can  be  expected. 

Finally,  some  comments  are  in  order  regarding  approaches  for  further 
investigation.  It  is  felt  that  the  mean  estimates,  since  they  now  approach  the 
Normal  in  efficiency,  are  probably  as  good  as  they  could  ever  be.  It  is  there¬ 
fore  concluded  that  any  future  investigations  should  be  directed  toward  improv¬ 
ing  the  efficiency  and  correlation  of  the  standard  deviation  estimates,  especially 
for  those  conditions  described  as  limitations.  More  specifically,  it  is  thought 
that  further  effort  toward  utilizing  the  Friedman  theory25  in  conjunction  with 
some  test  level  clustering  method  has  good  potential. 
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APPENDIX  I 


THE  BRUCE  TON  TECHNIQUE  FOR  SENSITIVITY  TESTS 


1.  The  Experimental  Procedure 

The  technique  consists  of  the  following  steps: 

1.  Choose  a  test  level,  h,  at  which  the  first  specimen  will  be  tested, 
and  an  interval,  d,  which  will  be  the  distance  between  testing 
levels. 

2.  If  the  first  specimen  fails  when  tested  at  test  level  h,  the  second 
specimen  will  be  tested  at  h-d.  If  the  first  specimen  does  not 
fail,  the  second  specimen  will  be  tested  at  h*-d. 

3.  In  general  a  specimen  will  be  tested  at  a  test  level  d  below  the 
level  at  which  the  previous  specimen  was  tested  if  that  specimen 
failed  and  d  above  the  level  at  which  the  previous  one  was  tested 
if  it  did  not  fail. 

In  this  manner  one  will  obtain  a  sequence  of  failures  and  successes 
which  may  be  recorded  as  in  Figure  11.  The  x's  denote  failures  and  the  0's 
denote  successes. 

Here  the  first  specimen  did  not  fail,  so  the  second  one  was  tested  at 
hf  d;  the  second  did  fail,  so  the  third  was  tested  at  h,  the  level  just  below  hH; 
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Figure  11.  Example  of  Bruceton  Test  Levels  and  Results 
the  third  failed,  so  the  fourth  was  tested  at  h-d;  the  fourth  failed,  so  the  fifth 
was  tested  at  h— 2d ;  the  fifth  did  not  fail,  so  the  sixth  was  tested  at  h-d,  the 
level  just  above  h-2d. 

On  the  basis  of  past  experience  it  is  usually  possible  to  make  rough 
estimates  of  the  mean  and  standard  deviation  for  the  item  to  be  tested.  Such 
estimates  are  used  in  choosing  h  and  d  for  the  experiment  to  be  performed. 

If  a  and  a  are  the  estimated  mean  and  standard  deviation  respectively,  then 
choices  for  h  and  d  are  simply  h  =  a  and  d  =  a. 


2.  Statistical  Analysis 

The  methods  provided  for  estimating  the  mean  and  standard  deviation 
are  based  on  the  assumption  that  the  critical  responses  (or  some  known  func¬ 
tion  of  them)  have  a  Normal  probability  distribution.  It  is  important  that 
this  assumption  be  reasonably  well  satisfied.  If  the  critical  responses  are 
not  Normally  distributed,  it  is  desirable  to  transform  to  a  new  variable  which 
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will  have  a  Normal  distribution.  In  biological  research  it  is  usually  found  that 
the  logarithms  of  the  critical  concentrations  rather  than  the  concentrations 
themselves  are  Normally  distributed.  There  is  some  evidence  in  explosives 
research  that  logarithms  of  testing  heights  are  also  more  nearly  Normally 
distributed  than  the  heights  themselves,  but  the  evidence  is  not  so  conclusive 
or  so  generally  accepted  in  this  field.  This  is  a  question,  therefore,  which 
will  usually  require  some  preliminary  investigation.  Any  effort  devoted  to 
finding  il  ihe  responses  are  Normally  distributed,  and  if  not,  what  function 
of  the  responses  is  Normally  distributed,  will  be  well  worthwhile.  It  is 
assumed  that  there  is  known  or  has  been  found  by  preliminary  investigation  a 
variable,  x,  which  is  Normally  distributed.  Any  reference  to  test  levels  in 
the  following  discussion  will  be  to  these  "Normalized"  levels.  The  original 
testing  level,  h,  and  the  interval,  d,  will  be  measured  in  terms  of  the  Normal¬ 
ized  level.  If,  for  example,  the  Normalized  level  is  the  logarithm  of  the 
actual  level  and  the  Normalized  interval  is  one,  then  corresponding  to  normal¬ 
ized  level -1,  0,  1,  2,  3,  would  be  actual  testing  levels  of  V 1,  10,  100,  and 
1000. 

The  statistical  methods  will  be  described  by  illustrating  their  use  for 
an  actual  drop  test  of  an  explosive.  In  this  situation  the  drop  height  is  the 
critical  response  variable.  Figure  12  is  a  chart  showing  the  results  of  the 
test  of  100  specimens  of  the  explosive.  On  the  left  the  lines  on  which  there 
were  tests  are  numbered  from  0  to  4.  In  the  table  below  the  chart  are  given 
the  line  numbers,  the  actual  testing  heights  (in  centimeters),  the  logarithms 
of  the  testing  heights,  the  number  of  explosions  (failures),  and  the  number  of 
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nonexplosions  (successes)  at  each  level.  The  set  of  numbers  is  the  same  in 


both  columns,  as  will  always  be  the  case  when  there  are  equal  numbers  of  0's 
and  x's.  When  the  total  number  of  0's  is  unequal  to  the  total  number  of  x's, 
the  number  of  0's  at  a  given  height  will  not  differ  by  more  than  one  from  the 
number  of  x's  at  the  next  greater  height. 

The  actual  heights  were  chosen  so  that  their  logarithms  were  equally 
spaced,  since  previous  investigation  of  similar  explosives  revealed  that  the 
logarithms  of  the  critical  heights  could  be  assumed  to  be  Normally  distri¬ 
buted.  The  interval  h  =  0.  093  in  log  units  was  used  because  another  experi¬ 
ment  with  a  similar  explosive  gave  this  value  for  the  standard  deviation. 

The  mean  and  standard  deviation  will  be  estimated  from  either  the  0’s 
or  the  x's  depending  on  which  occur  in  fewer  numbers.  In  the  particular 
example  given  in  Figure  12,  either  the  0's  or  the  x's  mav  be  used,  but  had 
there  been  49  0's  and  51  x's,  the  0's  would  have  been  used. 

Let  nfl,  nj,  n2,  ...  be  the  number  of  0's  (or  x's  as  the  case  may  be) 
tli  st  nd 

on  the  0  ,1  ,2  ...  lines,  respectively,  and  let  N  be  the  total  number  of 

0's  (or  x's).  Let  c  be  the  normalized  height  of  the  lowest  line  on  which  there 
was  a  test  recorded.  In  the  example,  the  x's  will  be  used  and  the  0's  disre¬ 
garded;  the  numbers  just  defined  will  then  be 

N=  50,  c=  0.928,  n„=  0,  n(  =  8,  n2  =  35,  n3  =  6,  n4  =  1. 

The  formula  for  the  estimate  of  the  mean  is 

m  =  c  +  d  (■“  2  ini  +  V2  j  (1) 

if  the  0's  are  used,  or 
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m  "  c  +  d  (n  2  ini  "  ^*) 


(2) 
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if  the  x's  are  used. 

The  standard  deviation  will  be  determined  by  computing 


then  using  this  number  to  find  s  from  Table  3  or  from  Figure  1.  After  s  is 
found,  the  estimated  standard  deviation  is 

a  =  ds.  (4) 

The  sums  appearing  in  Equations  (1),  (2),  and  (3)  can  easily  be 
computed  in  a  tabular  form, 


i 

"i 

lni 

0 

0 

0 

0 

1 

8 

8 

8 

2 

35 

70 

140 

3 

6 

18 

54 

4 

1 

4 

16 

N=  50 

A  =  100 

B  =  218 

where  the  data  of  the  example  in  Figure  12  have  been  used  and  the  two  sums 
2  in.  and  2  i2n^  have  been  represented  by  A  and  B.  In  terms  of  A  and  B,  the 
formulas  (1),  (2),  and  (3)  may  be  written 


m  =  c  +  d 


(5) 


where  in  Equation  (5)  the  plus  sign  is  to  be  taken  if  the  0's  are  used  and  the 
minus  sign  taken  if  the  x's  are  used. 
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All  computations  involving  the  heights  are  to  be  done  in  terms  of  the 
Normalized  heights  and  only  final  results  transformed  to  actual  heights.  Thus, 
for  the  particular  example,  the  mean  is 

m  =  0.  928  *  0.  093 

=  1.068,  (7) 

and  the  number  M  is 

__  50(218)  -  (100)2 

M - 50? - 

*  0.  360.  (8) 

From  Table  3  or  Figure  1  it  is  found  that  the  value  of  s  corresponding  to  M 
=  0. 360  is  s  =  0. 625;  the  standard  deviation  is  therefore  estimated  as 

<r=  0.093  (0.625)  =  0.058,  (9) 

which  is  considerably  smaller  than  the  value  (0.  093)  anticipated  and  used  for 
the  interval  between  heights. 

In  terms  of  actual  heights,  the  mean  m  =  1.  068  corresponds  to  11.  69 
centimeters,  and  this  is  not,  strictly  speaking,  the  mean  height  but  the  median 
height;  that  is,  the  height  at  which  there  is  an  even  chance  that  a  particular 
specimen  will  or  will  not  explode.  The  term  o  must  always  be  used  in  Normal 
units  (log  units  in  this  case) ,  so  there  is  no  point  in  transforming  it  to 
centimeters. 

The  value  of  s  depends  on  the  position  of  the  mean  relative  to  the  test¬ 
ing  height,  but  this  dependence  is  not  important  unless  M  is  less  than  0. 35. 
Figure  2  provides  curves  giving  the  value  of  s  as  a  function  of  M  for  various 
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positions  of  the  mean  when  M  is  email.  The  curve  marked  m-h  =  0  is  for  the 
case  where  the  mean  ie  at  one  of  the  testing  heights;  the  curve  marked  m-h 
=  0.  5d  is  for  tho  case  where  the  mean  is  midway  between  two  testing  heights; 
the  curve  marked  m-h  =  0. 25d  is  tor  the  case  where  the  mean  is  one  quarter 
of  d  away  from  the  nearest  testing  height. 

If,  for  example,  M  in  Figure  2  had  been  0.  20  instead  of  0. 36,  then  b 
would  have  been  determined  as  follows:  The  mean  m  is  1.  068  and  is  0.  046 
units  away  from  the  nearest  testing  height,  1. 114,  and  since  d  =  0.  093, 
the  mean  is  ~~~  =  0.  495d  ui  its  from  the  nearest  testing  height.  This 
happens  to  be  so  near  0.5d  that  the  interpolation  is  hardly  worthwhile,  but  it 
will  be  carried  through  as  an  illustration.  The  interpolation  is  between  the 
0.  25d  curve  and  the  0. 5d  curve  in  Figure  2.  From  the  0.  25d  curve,  s' 

*  0.  382,  and  from  the  0.  5d  curve,  s"  =  0.  409.  By  using  linear  interpolation, 


8=8'  + 


0.  495-0,25 
0.5-0.25 


(s'-s') 


=  0.382  +  0.98  (0.027) 


=0.408.  (10) 

Table  3  may  be  employed  for  values  of  M  greater  than  0.  30.  The 
values  in  the  table  are  for  the  case  where  the  mean  falls  on  one  of  the  testing 
heights.  The  differences  inserted  for  M  between  0. 30  and  0.  72  give  the 
amounts  by  which  the  tabulated  values  are  changed  when  the  mean  falls  midway 
between  two  testing  heights.  The  differences  are  0  (to  four  decimal  places) 
beyond  M  =  0. 72.  When  the  mean  does  not  fall  on  a  testing  height,  or  falls 


midway  between  two  of  them,  interpolation  may  be  employed  as  above.  Thus, 


if  M  were  0. 33  and  if  the  mean  were  0. 2d  from  the  nearest  testing  height,  s 
would  be 


s=  0.5711+  £-§  (0.0070) 
0*  o 


=  0.5739. 
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APPENDIX  II 

THE  MISSILE  TECHNIQUE  FOR  SENSITIVITY  TESTS 


1.  Determining  the  Test  Interval 

The  first  step  to  be  performed  in  this  technique  is  the  determination 
of  the  test  interval  which  is  used  as  the  basis  for  generating  the  stress  or  test 
levels.  This  interval  should  be  selected  large  enough  to  include  all  possible 
ranges  of  strengths  (test  environment)  of  the  parts  to  be  tested.  This  interval 
can  be  made  conservatively  large,  since  the  Missile  method  has  been  designed 
to  cause  the  stress  levels  to  be  generated  in  the  vicinity  of  interest  (i.e. ,  in 
the  vicinity  of  the  distribution  of  strengths)  as  the  test  proceeds.  As  a  sample 
illustration,  the  range  for  a  drop  height  test  for  glass  containers  designed  to 
withstand  say,  a  6-inch  drop,  could  be  chosen  to  have  a  lower  limit  of  0  and  an 
upper  limit  of  3  feet.  The  method  of  analysis  of  the  data  is  such  that  the 
particular  choice  of  the  endpoints  of  the  test  interval  does  not  have  an  appreci¬ 
able  effect  on  the  results  for  sample  sizes  of  15  or  more.  In  the  event  that 
the  test  interval  turns  out,  as  the  test  proceeds,  to  be  inappropriately  chosen, 
then  the  stress  levels  will  tend  to  converge  towards  one  limit  or  the  other.  In 
Figure  13  are  represented  the  results  of  an  actual  one-shot  test  on  thermal 
batteries  to  determine  their  reliability  with  regard  to  high  temperature.  In 
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this  instance,  the  batteries  were  designed  to  perform  reliably  at  145^F.  On 
the  basis  of  conservative  engineering  judgement  and  some  limited  development 
test  data,  the  lower  limit  was  selected  to  be  100°  F  (the  level  at  which  aH 
thermal  batteries  would  be  expected  to  perform  satisfactorily)  and  the  higher 
limit  was  selected  to  be  350°  F  (the  level  at  which  all  thermal  batteries  would 
be  expected  to  fail). 


2.  Selecting  the  Test  Levels 

Once  the  test  interval  has  been  established,  the  test  is  begun  by  select¬ 
ing  the  first  test  level  at  the  midpoint  of  the  interval.  After  the  first  speci¬ 
men  is  exposed  to  this  environmental  level  and  activated,  a  1  or  0  is  recorded 

to  indicate  the  outcome  as  a  success  or  failure,  respectively  (Figure  13). 

st 

The  general  rule  for  obtaining  the  (n  +  1)  test  level,  after  complet- 

th 

ing  n  trials,  is  to  work  backward  in  the  test  sequence,  starting  at  the  n 

th 

trial,  until  a  previous  trial  (call  it  the  p  trial)  is  found  such  that  there  are 

as  many  successes  as  failures  in  the  p^  through  the  n^1  trials.  The  (n+  l)0t 

th  th 

test  level  is  then  obtained  by  averaging  the  n  test  level  with  the  p  test 

level.  If  there  exists  no  previous  test  level  satisfying  the  requirement  stated 

st  th 

above,  then  the  (n  +  1)  test  level  is  obtained  by  averaging  the  n  test  level 

with  the  lower  or  upper  limits  of  the  test  interval  according  to  whether  the  n^ 
result  was  a  failure  or  a  success.  To  illustrate,  suppose  it  is  desired  to  find 
the  second  test  level  in  Figure  13.  Since  there  was  only  one  previous  observa¬ 
tion  (i.  e. ,  first  unit  failed) ,  it  is  not  possible  to  And  a  level  where  all 


intervening  results  even  out.  That  is,  the  second  test  level  is  obtained  by 
averaging  the  first  with  the  lower  limit.  To  find  the  eighth  test  level,  it  is 
observed  that  results  from  tests  4  through  7  (1.  e. ,  the  last  four  results) 
cancel  each  other  out.  Thus,  the  eighth  test  level  is  obtained  by  averaging  the 
fourth  level  with  the  seventh. 

The  test  level  is  designated  by  the  letter  s  and  the  outcome  is  desig- 
nated  by  the  letter  u.  The  lower  limit  of  the  test  interval  is  designated  A  and 
the  upper  limit  is  designated  B.  Upon  the  conclusion  of  the  test,  the  test 
levels  ^slt  s2,  ....  s^  and  the  corresponding  outcome  ^Uj,  u2,  ...,  u^  , 
where  N  equals  the  test  sample  size,  are  used  to  perform  the  analysis. 

3. 

The  stress  levels  ^e1(  s2,  ....  s^  and  the  outcomes  (uu  u2,  . . . , 

u_T^  arte'  analyzed  tg  calculate  the  sample  mean  and  standard  deviation  //u 
N  /  *  -  - -  '  e 

anh  .  This  appendix  describes  the  procedure  for  performing  these  calcu¬ 
lations.  Included «lso  is  an  analysis,  by  way  of  illustration,  of  the  thermal 
battery  data  preedited  in  Figure  13. 

In  shmmary,  the  steps  to  be  followechin  performing  the  analysis  are 
(1)  calculate  the  mean  and  standard  deviation  of  the  sample  and  (2)  correct 
the  calculated  standard  deviation  for  bias. 

4.  Calculating  the  Sample  Mean  and  Standard  Deviation 

The  maximum  livelihood  equations  for  n  and  a  are  as  follows: 

e  e 


performing  the  Analysis 
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(1) 


p  (v  ffe)  =  1  *h=  0 

q  (V  ffe)  =  2  ,*h  =  °' 

where  the  sum  is  taken  over  N  samples  and  where  t,  g,  and  h  are  given  for 
each  sample  by 


V  ^e 

t  - - -  normalized  stress  deviate 


_  1/ 

g=  (2? r)  2  exp 


(=#). 


Gaussian  ordinate  for  t 


h  =  u~—  -  *  —u  =  "outcome"  weighting  parameter 

1  -  G  G 

and 

/ 

t 

G  -  f  gdt  =  Gaussian  area  from  -«  to  t. 

-OO 

Tables  for  G  and  g  are  available  in  almost  any  engineering  or  mathe¬ 
matical  handbook  (for example,  Handbook  of  Mathematical  Tables  and  Formu¬ 
las  by  R.  S.  Burington,  Handbook  Publishers,  Inc.,  Sandusky,  Ohio).  The 

problem  is  to  find  values  of  n  and  a  which,  when  used  with  the  stresses  and 

e  e 

outcomes  obtained  in  the  laboratory,  cause  the  summations  in  Equation  (1) 
to  be  0.  The  procedure  used  is  to  obtain  a  Taylor's  expansion  about  the  solu¬ 
tion  point  ^e>  ae  ^  for  p  and  q  and  iterate  until  the  sums  in  Equation  (1) 
become  sufficiently  close  to  0.  The  formulas  for  this  analysis  are  given 
subsequently.  This  method  requires  that  an  initial  approximation  (n0,a0), 
be  made  of  the  solution  point  so  that  t,  g,  and  h  can  be  calculated  in  the  itera¬ 
tive  process.  The  initial  approximation  is  made  as  follows: 

1.  Denote  the  highest  stress  for  which  a  success  occurred  as  i px. 
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2.  Denote  the  lowest  stress  for  which  a  failure  occurred  as  ^0. 

3.  Count  the  number  of  remaining  stress  levels  which  fall  In  between 
ipfj  and  ipt-  Denote  this  as  n^. 

4.  Calculate 

M o=  V2  (4> i+  <P0) 


N  (ipi-ip 0) 

5.  If  (T0  is  negative,  the  calculation  terminates .  The  outcome  is  said 

to  be  degenerate  and  the  conclusion  should  be  as  follows: 

lies  between  ( )  and  ( ip0 ) 

a  =  0  (i.e. ,  too  small  to  be  measured), 
e 

A  degenerate  outcome  does  not  preclude  the  possibility  that  the 
population  mean  might  be  outside  the  interval  i pt  to  4>o-  However, 
if  a  degenerate  outcome  occurs  for  samples  of  N  =  15  or  more,  it 
is  indicative  of  very  small  variation  in  strength  (failure  point) 
from  sample  to  sample. 

Example 
From  Figure  13, 


therefore 


^ l ~  215  ipQ  =  187  n^  =  2, 


Vi  (215+  187)  =  201 


_  15  (215  -  187)  A 

a°  8  (2+  2)  "  13,0  ‘ 


Given  the  values  /i0  and  <r0,  t,  g,  and  h  can  be  calculated  for  each  stress 
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level-outcome  pair.  After  the  corrections  A p  and  Ac  are  obtained,  new  values 
of  t,  g,  and  h,  and  sums  (1)  are  calculated  to  obtain  still  closer  approxima¬ 
tions  to  p  and  ct  until  convergence  is  reached. 

6  0 

Once  the  maximum  likelihood  estimates  of  p  and  a  are  calculated,  it  is 

necessary  to  correct  the  estimate,  a  ,  for  bias.  The  unbiased  standard  devia- 

© 

A 

tion,  denoted  a,  is  given  by 

^  =  °e/tl  ’ 

where  /3=  bias,  and  is  the  ordinate  of  Figure  14. 


5.  Calculation  Methods 

In  order  to  calculate  values  of  p  and  a  satisfying  Equations  (1),  a 
Taylor's  expansion  about  the  solution  point  ^Pe>  was  used.  For  points 
(p,  a)  in  the  neighborhood  of  ^p^,  ,  the  following  formulas  hold  approxi¬ 

mately: 

0  -  p  Jpe,  =  p  (p ,  a)  +  Ap  p^  +  Act  p^ 

°=  q  /p  ,  a  \  =  q  (p,  cr)  +  Ap  q(  +  Aa  q  ,  (2) 

\  e  e^  pa 

where  p^,  etc.,  indicate  partial  derivatives.  These  partial  derivatives  are 
given  as 

p  =  tf"1  (2  t  g  h  -  2  (g  h)2]  -  a"1  |p  -  2  (g  h)2j 
p^  =  a" 1  2  t  g  h  (t  -  g  h) 
q  =  (T1  [2  t  g  h  (t-gh)-2gh]  =  p  -pa'1 

fA  V 

q^=  a-1  [2  t2  g  h  (t  -  g  h)  -  q). 

By  using  Equations  (1)  and  the  above  expressions  for  the  partial  derivatives, 
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Equations  (2)  can  be  solved  for  An  and  A ct,  for  each  given  outcome,  u. 
Then,  since 


a  =  ct  +  Act, 
adj 


(3) 


the  adjusted  values  can  be  resubstituted  into  (2)  to  obtain  still  closer  approxi¬ 
mations.  Any  suitable  criterion  of  comparison  can  be  used  to  terminate  the 
calculation,  such  as: 

|  Act  |  +  I  An  |  <5. 10-5. 


r 


6.  Sample  Analysis 

Figure  13  presents  the  results  of  a  high  temperature  sensitivity  test 
for  fifteen  thermal  batteries.  The  three  columns  to  the  left  in  Table  13  contain 
the  results  in  tabulated  form  suitable  for  calculation  purposes.  By  using  the 
initial  estimates  for  the  mean  and  standard  deviation  calculated  earlier  in  the 
example,  a  high  speed  digital  computer  can  be  used  to  iterate  by  using  the 
equations  given  in  the  preceding  section  until  the  sums  of  gh  and  tgh  are  0  to 
four  decimal  places.  To  illustrate  the  calculation  of  these  quantities,  columns 
1  through  5  are  tabulated  for  n~  n  and  ct  =  ct  .  The  items  appearing  in  the 

C  0 

first  row  are  discussed  separately  below:  (see  formulas  for  reference). 

Column  1:  t=  (225  -  199.  8)/20.  39  =  1.234 

\J 

Column  2:  g=  (9,n)  2  exp  -  (1.  2342/ 2 >  *  0.  1863 


83 


Column  3:  l/h  =  -area  (-« to  t)*  =  -0.  8914 
Column  4:  gh  =  (column  ?.)/  (column  3)  ■  -0. 2090 
Column  5:  tgh  =  (column  1)  x  (column  4)  ■  -0.2579. 

From  Table  13,  it  can  be  observed  that  columns  4  and  5  run  to  0,  thereby  indi¬ 
cating  that  /x  =  199.  8  and  <j  =  20.  39  are  truly  maximum  likelihood  estimates, 
e  © 

The  final  step  in  the  analyyis  is  to  eliminate  the  bias  in  a  .  From  Figure 

6 

14,  /3  =  0. 76  for  N  =  15.  Hence, 

ct=  20.39/0.  76  =  26.83. 


APPENDIX  III 


BASIC  COMPUTER  SIMULATION  PROGRAM 


1MH 


EFN  S3JACE  STATEMENT 


IFNISI 


- STmmon  -  of  5EN$fTTmf  tests  -  - 

REAL  N,NME,MDE,LLIN 

DIMENSION  RNN(60),A( 31,3(3)  •  S I G<l 1 601 

COMMON  ANOf.Ol.H.DELTA.NS.SETA.UUOMJllN.LLlN.PS.TABIAlO)  •  SNULT , 
1  XNJLT 

DATA  A, 3/2.515317,  .802853,  . 010328, 1 . 432788,  .  189269, . 001 308/ 

•  -  NAHItnr  /IN/  PXB,PS,H, DELTA, NS,  ND.6ETA, MNr , JLIM, LL  !M, SMMLt , XMULT 
NAMELIST  /OUT/ANO,RNN,  SI3N 
I  RE  ADI  5 , I N) 

WRITE!*, INI 
TAB  »  3. 

D3  5  1-2,410 
TABTI I  -  TAB(I-l)  ♦  .01 
5  C3NTUJE 
SXBRN  -  0. 

SXBRN2  -  0. 

SS AN  >  3. 

SSRN2  «  0. 

SXBN  •  3. 

SXBN2  >  0. 

SXB3  >  3. 

SXB32  -  0. 

SSB  -  3. 

SSB2  -  3. 

SSM  -  3. 

SSN2  •  3. 

SSBSRN  >  0. 

SSMSRN  -  0. 

WAITE! S,2305) 

WRITE! 5»2000)PXb,PS»NS 
03  43  I-1.N3 
9  SJMl-3. 

SJM2  .  3. 

D3  23  J *  1 , NS 
SI  ONI J  I  «  1. 

AAN3  «  ABSIRNINNTI) 

IF!  .5  . 3T.  HANOI  DO  TD  10 
RAND  »  1.  -  RANI) 

SIDNIJ)  •  -1. 

10  TN  >  S3RTIAL0G!  1./RAN0--2)  ) 

RNNIJ)  •  UN  -  (A|  1)*AI2)*TN+AI3) -TM--2I  /( l.*0Il)»TN»B(2 ) -TM--2* 
l  3! 3)»TM»*3) )  •  SI5NIJ) 

RNOIJ)  -  PXB  ♦  RNNIJ)  •  ’S 
SJMl  >  SUM1  ♦  RNOU) 

SJM2  •  SUN2  ♦  RNCMJI--2 
20  CONTINJr 

CALL  3RJCMHXB3,SO,  N I 

CALL  NISSMTlXttN.SP,  *A) 

XORN  -  SlIMl/FLOAT INS) 

SRN  »  S3RT l ABS( ( SUH2  -  SJNI--2/F.DATINS) I/Fl3AT(NS-I  I  I  I 

SX3AN  *  SXBRN  ♦  XBRN 

SXBRN2  •  SXBRN2  ♦  XURN--2 

SSKN  »  SSRN  ♦  SKN 

SSRN2  •  SSRN2  ♦  SRN--2 

SXON  •  SXBN  ♦  XBN 


HIN 


£F?4  S3UR3E  STATEMENT 


IFV!S> 


SX6V2  ■  SXBM2  ♦  X8M«»2  _  _ 

- STIT  "•  SXBB  ♦  XBB 

SXBB2  »  SXBB2  ♦  XBB*»2 
SSB  •  SSB  ♦  SB 
SS82  »  SSB2  ♦  SB»»2 
SSN  -  SSM  ♦  SM 
SSM2  >  SSM2  ♦  SM#*2 

- SSBS3N  «  SSBSRV  ♦  SB»$RV 

SSMS3V  ■  SSMSRV  ♦  $M»SAV 
WMTE!  5,2001)  1* XBAVtXBtt,  <3V,SXVtSB,SM,R 
2d 31  FORMAT!  1 IX,  15,71  3X.F11.5)  > 

BO  CONTINUE 

FMMl  »  NO  -  1 
FVD  «  M3 
XBX3M  «  SXBM/FMO 
X3XB3  ■  SXBB/FM3 
X3X3RV  «  SXBRN/FNO 

STXBRN  «  SORT  (  ABS  ( (  SX8RN2  -  SXB3M»* 2/FM3 ) /FNM1)  ) 

STXBB  -  SORT ( ABS ( ( SXBB2  -  SXBB«»2/PNO ) /FNM1 )) 

STXBM  -  SORT { ABS! ( SXBM2-  SXBN««2/FN0 I /FNMl )  ) 

XBSRN  >  SSRN/FNl) 

XQSB  -  SSB/FNO 
X8SM  •  SSM/FNO 

STSRN  -  SORT I ARS! ( SSRN2  -  SSRN»»2/FNO ) /FNM 1 )  ) 

ST  SB  -  SORT! ABS( { SSB2  -  SSB»«2/FNO)/FNMl  )) 

STSM  -  SORT ( ABS ! ( SSM2  -  S$H«*2/FV0)/FNHl I ) 

TAUB  -  (  FNG«SSBSRN  -  SSB»SSRN I /SORT  {  !FNO«SS82-SSB»»2>«  I FNO* 
l  SSRN2  -  SSRN»»2‘  ) 

TAUM  ■  ( FNO*SSMSRN  -  SSH*SSRN > /SORT  1 (FNO*SSM2  -  SSM*«2)»  (FNO  • 

1  SSRN2  -  SS«N»*2)  ) 

PXBH  -  ABSIPXfc-XbXHB) 

PXBM  «  ABS ( PXR-XBXBM I 
PXBRN  *>  AB$(PXB-  XQXURNI 
PSXSB  -  ABS(PS  -  XBS3) 

PSXSH  »  ABSIPS  -  XBSM) 

PSXSRN  -  ABSIPS  -  XBSRN) 

BHfc  •  PKBRN/PXBB 
33E  ■  »SXSRN/  PSXSB 
Rife  «  PXHAN/PXBM 
M3E  «  PSXSRN/PSXSM 

Nil  Tc(5, 2002) X8XbRNfSTXS3N,XHSAM» STSRN, PXBRM, PSXSIV,  XBXBB, STXBB, 

1  XBSB,STS3,PX3B,PSXS3,XDXBN,STX3M,XB$N,STSM,PXBM,PSXSM 

N31TE(S,2003)BMt,MNE,B0E,M3E,TAJ3, TAUM 
33  T3  1 

2300  FORMAT!  15X,lOHP3PUlAT!ON,  13X.6H  XJ  «F8. 5, 3X , 7HS! SNA  ■F8.5/11X, 

1  18HTEST  SAMPLE  S12 1 , 6X ,  I  5//// 11 X ,  5H  TEST, 5X.6MXB!  RN) ,  91 

2  5HXBIB),  9X.5HXHM),  9X,5X$IRN),  9X,  VMS! B) ,  10X.4MS  ( M)  ,  12X 

3  1HM  //) 

2002  FORMAT ( //// l IX, 9HPR0CCUJ1E,  7X,  BHXB! ME AN) ,  B«, THSC BEAN)  »  9X, 

1  8HXBIS.D. ), 0X, 7HSIS.0.),  1 3X, 5HMU-XX.il X.6HSIG-XS///1 IX, 

2  6HNORMAL,3X,d(ax,Fll.5)71lX,  BHBAj:ErON,lX,6l5X,Hl.5)/llX 

3  7HMISSILC,2X,6(5X,F11.5)  ) 

2003  FORMAT!  7///11X.5HBMC  ■  F 1 1 . 5 #  10X,  3MMME  •Fll.5//llX,5H80E  -FIX. 5, 

l  10X  ,  5HMOE  ■Fll.5//11X,5HTAU3«F11.5,10X,  5HTAUM*F  1 1  •  5 ) 

2005  FORMAT! 1HI) 

E  VO 


3A9  -  EFN  S3UR:E  STATE9E9I  -  IF^ICSI _ - 


■smrnnrrNE  bajcmtub.s.n  l 

RMI1E  FOR  BKUCETON  METHOD  _ 

REAL  4 

20NN3M  ANO(60),H,DELTA,'JS,3ET»,UUO),ULIN,LlIH,PS,TAB(410)  , SNULT, 
1  <4JLT 

DIMEMSI 3N  STSLt 60)  ,  FOS< 63) , SL( 60) , TXB ( 751 .  TS(  75* ,E31 ( 75) ,EQ2 1 751^ 
T  T1I60),TABZQ(410>,TA8ZP(367) 

NANcLIST/OT/SLN,SLHX,FN, J,$TSL,S. 

NAN: LI ST/OT1/N,SL,FOS,TX3,7S,EQ1,EQ2,XI,AN1,AN2 

DATA  ( TABZPl  1  )•  1-1.256)/.  798, . 792 , . 785,.  779, .  773,.  766, . 763, .754, 

1  .748,. 741,. 735,. 729,. 72 3,.  7 17,. 71 1,. 705,. 699,. 693,. 687,. 881 ,.675, 

2  .669,. 663,. 657,  .652,  .646, .640,. 634,. 629,. 62 3,. 61 7,. 612,. 606,. 6, 
T .595, .589,. 584,.  578,. 573,. 567,. 562,. 556,.  551  ,.546,. 540,. 535,. 530, 
4  .525,. 5 19,. 514,. 509,. 504,. 499,. 494,. 489,. 484 ,.479, . 474, .469, . 464 , 

5. 459..  454.. 449,  .445, .44, . 435, . 43, .426, .421 ,.  4 17, .  412 , .407, .403, 

6.398. .  394.. 389,  .385,  .381,. 3 76, .372,. 368,.  361,. 359,. 335,. 351 1. 346, 

7. 342..  338.. 334. .33,  .326,.  322.. 31 8,. 314,.  31,.  306,.  303,. 299,. 295, 

8. 291..  288.. 284.. 28.. 2, 77,. 27 3,. 269,. 266,.  262,.  259,. 255,. 252,. 249, 

9. 245..  242.. 239.. 235.. 232. .229. .226. .223,  .219,  .216,. 2 13,. 21,. 207, 

A. 204,. 231,. 198,  .195,. 199, .19,. 187,.  184,. 181,.  179,. 176,. 173,.  171, 

8. 163.,  165,. 163,.  16,. 158,.  155,.  153,.  15,. 148,.  146,. 143,. 141,. 139, 

;. 137,. 134,. 132,  .13,. 128,  .  126,.  124,.  121,.  11 9,.  11 7,. US,. 113,. Ill, 

0. 1 1,.  138,. 106,.  104,. 102,.  1,. 098,. 097,. 095,.  393,. 092,. 09,. 088,. 087, 
E  .085, .383, .082,. 08,. 079,. 377,. 076, .074,  .073,. 072, .07, .069, .068, 

F  .066,. 365,. 064,. 062,.  061,. 06,. 039,. 358,.  056,  .055,  .  054, .053, .052, 

*  .051,. 35,. 349,  .048,. 347, .346, .345,. 044,.  043,  .042,.  041,. 04,. 039, 

■i  .038,. 338,. 037,. 036,. 095,. 034,. 334,. 033,.  032,.  331  ,. 031,. 03,. 029, 

I  .029,. 328,. 027,.  027,. 026,.  325,. 325,. 024,.  324,. 023,. 023,. 022,. 022, 
J  .021,. 32,. 02,.  019,. 019,. 31 9,. 01 3,. 018,.  31  7,.  017,.  316,. 016,. 016/ 
DATA  {  f AB2PI 1 ) ,  I  *257,  967) /. 01 5 , . 315, . 014,  .  31 4 , . 014, 3*. 01 3, 3*. 012 , 

1  3*. 01 1,4*. 01, 4*.  009, 5*. 008, 5*. 33 7, 5*. 006, 7*.  005, 8*. 004, 11 *.003, 

2  16*. 332, 31*. 031,0./, (74323(  1), 1*1, 191)/. 798, .8 04, .811, .817, ,82 4, 

3  .833, .9 36,. 843,.  849,. 656, .863, .869,. 876,.  882,. 889,. 896,. 902,. 909, 

4  .916, .923,. 929,. 936,. 943,. 95, . 95 7, .964, .  97, .  977, .  984, . 991 , . 998, 

5  1.335,1  .012,  1.019,  1.326,  1.039, I. 340, 1 ,3*7, 1 . 084, 1 . 062 , l .069, 

6  1.076,1.083,  1. 090,  1.097, 1.  1 05, 1.112, 1.119,1.  126,1. 134,1. 141, 

7  1.143,1.156,  1.  163,  1.17) ,  1. I  78, 1.183, 1.1  *3,1.2,1.237, 1.2 15, 1.222, 

8  1.23,1.237,1.245, 1.253, 1.26,1.268,1.273,1.293,1,29, 1.298,1.306, 

9  1.313,  1.321,  1.329,  1.3  36,  1.344,  1.  352,1.36,1.  167,11.375,1.383,1.391, 
4  1.399,  1.406,  1.414,  1.422,1.43,  1 . 4 38 , t . 446 , 1 . 4 54,1 . 46 1 , 1 . 469 , 1. 477 , 
B  1.495,  1.493,  1.501,1.509,  1.517,1.525,  1.513,1.541,1.549,1.557, 

;  1.555,1.573,1.881,1.59,1.398, 1.606,1.614,1.622,1 . 53, 1.638' 1 .646* 

0  1.555,  1.663,  1.671, 1.679,  1.687,1.696,1.704,1.712,1.72,1.729,1.737, 
E  1.743,  1.754,  1.  762,  l. 77,  1 . 779,  1. 787, 1.793,  1.904,1.812,1.82,1.829, 

F  1.9  38,  1.846,  1.854,  1.862, 1.871, 1.879, l.eSB,  1.6*6, 1.905, 1.913, 

3  1.922,  1.93 ,1.9)8,  1.947,  1.933,  1. 964,  1.972,1. 981,1. 99,1.998,2.007, 

3  2015,2.024,2.033,2.041,2.05,2.399,2.067,2.376,2.084,2.093, 

1  2. 132, 2. 11,2. 119, 2. 128,  2. 136, 2. 145, 2. 134, 2. 162, 2. 17 1, 2. 11,2. 188, 

J  2.197, 2. 206, 2. 219, 2. 223, 2. 292, 2. 241. 2. 25, 2. 258, 2. 267, 2. 276, 2. 285/ 
OATA( 7 ABZQI I ) , I* 192, 403 )/2. 294, 2. 303, 2.311,2.  32,2. 329,2. 331,2,346, 
12. 355, 2. 364, 2. 373, 2. 381, 2. 39, 2. 399, 2. 408, 2. 41  7, 2. 426, 2. 435, 2. 444, 

2  2.453,2.462,2.47,2.479,2.888,  2.497,2.906,2.513,2.524,2.593, 

3  2. 542, 2. 55 1,2. 56,2. 569, 2. 578, 2. 387, 2. 996 ,2. 6 05, 2. 514,2,623,2*632, 

4  2. 641, 2. 69, 2. 659,  2. 668,  2. 677, 2. 687, 2. 696, 2. 709,2. 714, 2. 723, 2. 732, 

5  2. 741, 2. 75, 2. 739, 2. 768, 2. 777,  2. 786, 2. 795, 2. 80S, 2. 814, 2. 823, 2. 132, 


\ 


-  EFM  SOURCE  STATENEMT  -  IFNI S  > 


6  2. 641, 2. $5,2. #59,2. 868, 2. 978, 2.SB7.2. 896. 2. 905*2.914,2. 923*2.932* 

- rrrmTY:  ^rrr.n  z.nr,  t.tbt,  ttw  7  ;t.t>  ot  .T.oir.T.ii?  4,5.015; 

B  2. 34|, 3. 052, 3.061,1. 07,  3. 079,  3. 089, 3. 098, 3. 107, 3.  116, 3.126, 3. 135, 
1  3.148,3.151,3. 163,  3. 172,3.  181. 3.19,1.2,3.209, 3. 218,3.12^3.7^  ' 

4  3.245,3.255,3.265,  3.274,3.283,3.292,3.302,3.311,3.32,3.33,  3.3 
83. 348,3. 358, 3. 367, 3. 376,  3. 386, 3. 395, 3. 404, 3.  413, 3.  423, 3. 432, 3. 4 
O  3. 45 1,3. 46, 3. 47, 3. 479, 3. 488, 3. 438, 3. 507, 3. 516,3. 526, 3. 535, 3. 54- 
3  l.'f  5 4,T.  533, 3.573,  3.  582,  3. 59 1 , 3.601, 3.61, 3.62, 3. 62973. '618,3^648, 

E  3.657,3.667,3.676,3.685,3.695,3.704,3.714,3.723,3.732,3.742, 

F  3.751,3.761,3.  77,3.78,3.  789,3. 7)9,3.808,3.817,3.827,3.836,3.846, 

0  3.855,3.865,3.874,3.884,3.893,3.902,3.912,3.992,3.931,3.94,3.95, 

9  3.95  9,  3.969,  3.978,3.988,  3.997,4.  007,4.016,4.026,4.035,4.045, 

I  4.054,4.064,4.073,4.083,4.092,4.  1 02, 4. 1 1 1 , 4.  121 , 4.  1 3, 4. 14, 4. 149, 

- Y  4.159, 4.169, 4.  178, 4. 188,  4.  W,4.  206, 4. 216,4.226, 4. 235, 4.2457 

D4T4  I  74820(1),!  »'*04, 4 10 1/4.254,  4. 264, 4.  273,  4. 283,  4. 292, 4.  302, 

1  4.312/ 

IXBCOM  •  0 
ISCOM  *  0 
HH  «  1 
MF  «  3 
MSS  •  3 
SUM  «  HH 
SLMX  •  -IH 
03  15  I ■ 1 , NS 

1FI3M3II)  .  GE .  nHliiO  TO  5 
STSU1I  «  HH  , 

J(I)  >  3. 

MF  »  MF  ♦  l 

HH  ■  HH  -  DEL  7 4  ' 

33  13  13 
5  Jill  ■  1. 

STSLI 1 )  ■  HH 
HH  »  HH  ♦  DELTA 
MSS  •  MSS  ♦  l 

10  SLH  »  48IMKSLM, STSLI  ID 
SLMX  «  AM AX  1 ( SLMX , STSL 1 1  > ) 

15  CONUMJE 

FM  •  4UN0(MF,MSSI 
02  •  1. 

IF(M=  .LE.  MSSI J2  «  0. 

CALL  :HEK(SLH,SLMX,:)2,SrSL.F0S,<,  su 
M32  »  32  ♦  1. 

SJN1  •  3. 

SJK  •  3. 

03  25  I • 1 , K 
FIN  •  I  -  1 
SJM  «  SJH  ♦  F1H«T0S(I) 

sjmi  •  sum i  ♦  fim»»:»fos< i ) 

25  CONUMJE 

03  73  I  30, 35) , MOZ 

30  XJ  .  SU  ♦  OELTA  •ISJM/CM  ♦  .51 
33  T3  43 

35  X3  •  SIM  ♦  OELTA  MSUM/FM  -  .51 

40  S  ■  1.620  •  OELTA  •UFNtSJNl  -  SJN*»2)/FM»»2  ♦  0.029) 

N  ■  SJNUFN  -CSJM/FN1»*2 
I F ( N  .JE.  . 325) 1ETURN 


4 


i 


i 

I 
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St*  -  EFN  SOURCE  STATEMENT  -  IFNIS1 

1  ■  1 

- rmnr.EO.  lisa  to  so 

jj  «  < 

30  45  JN«1,X 
F3SIJJ»1)  *  FOSIJJ) 

JJ  «  JJ  -  1 
♦5  C0N11XJE 
■"50'  TXSil)  ■  XB 
TSIX)  »  S 
E 31 1  X)  >  0. 

E32IX)  «  0. 

03  85  I«l,K 
11(11  «  ISL( t I-XB//S 
■  ~  rFTI  .  :  3.  1)30  13  85 

XX  •  1 
NX*l  *  1 

IF(XMI-l)  .IT.  O.JNXNl  ■  2 
IFUU1)  .11.  3.  )  NX  «  2 
C3  13(55, 60). MINI 
55  All  •  5.312 

IF(XIII-l)  ,G1.  5.09)30  13  65 

CALI  I  XI ERP( X 1 1  1-1)  .  FAB,  14323,  413,4,  AXl.XEtt) 

03  13  55 
60  AN1  «  3. 

IFI43SI X  I  ( I ■  1 ) )  .31.  1.65)33  10  55 
AAA  •  43SIXII 1-1 ) ) 

CALL  IN1ERPIAAA  , 1 AB. 1 A3ZP, 361 , 4, AMI , XE « ) 

65  C3  1*' 73, 75), NX 
70  AN2  3. 

I F I  XI ( 1  )  .01.  3.66)33  13  83 

CALL  IXIERPiXl(l),lAB,143l>,367,4,AN2,XERR) 

G3  13  53 
75  AN2  «  4.11? 

I F I A3S ( X  I  ( I ) )  .31.  4.09)33  13  AO 
AAA  ■  43S1 XI ( 1)1 

CALL  I  X1EAPI  AAA  ,  1  AB ,  1 A32  3 , 410,  4 ,  M2,  XE  A  A ) 

80  E311X)  «  EOKN)  ♦  FOSIIIXANI  -  4X2) 

E32IX)  •  EQ2IX)  ♦  FU5IU  *  (  X I  ( I  *  l )  «AX1  -  X!(I)*AX2) 
85  C3NII XJ; 

I F ( X  .XE.  1)30  13  90 

IF1X3  .31.  1  • ) X  J * X H  -  (XXJL1«X8> 

IFIX3  .LE.  l.)X:*XB  ♦  (X4JLMXB) 

S  ■  S  *■  (5HUL1  •  S) 

X  ■  X  ♦  1 
33  13  53 

90  I F I  1 X 3 C 3N  .63.  1)U0  13  135 
CALL  UR(X,E31, 1X8, XB, *133) 

I F  I IX  31 1 1  .31.  l.)XD»XB  -  ( XXULT • XB  ) 

IF ( 1X3( 1 )  .LE.  l.)XB«<0  *  ( XXJLl •  XB ) 

100  1F(A3S(XB-1X8(X)).C1.  .3331)33  13  105 
1 FBC3X  *  1 

135  1FU5C3X  <£Q.  1)3(1  10  113 
CALL  m<N,E32,!S,S,»106» 

S  ■  i  *  ( SMJL T»3 ) 

106  IHA3S(S-)S(N)I  .(31.  .0031)30  13  115 
ISC3X  >  1 


IMIS) 


\ 


-  fcM  S3dR  £  STATEIM? 

113  1HIS33M  .tO.  1  .ANO.  IX333M  .£3.  DAtTJAN 
115  N  •  H  *  1 
33  r 3  53 
MO 
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Z4  -  EFN  SOURCE  STATEMENT  -  IFNIS1 


- -  TJBMjriNE  CMEK(SHIN,SH*<,32,srSL,F0S,l<,$Ln 

C 

0INENSI3N  F0S(60),STSU63),SL1163> 

C3M3N  ^N0(60)iH,0ELT*i'JS»3ETA,LJ(60)fULIM,L..IM,PStT *8(^10)  ,SNULT, 
1  XNJLT 
K  *  1 
SL  -  S'*! N 
1  F3S(<>  •  0. 

03  5  1 ■ 1 » NS 

IFIA9SISL  —ST  SL 1 1 ) 3/ABSC  SL I  .ST.  .00001130  T3  5 
IF (U(  I )  .NE.  0Z I  GO  TO  5 
F3S<<)  *  FOS(K)  ♦  l. 

5  C3NTINJ: 
sum  •  sl 

K  «  <  *  1 

SL  *  SL  *  0ELT4 

1F(SN«X  .L.E.  SL  I  SO  TO  1 

K  *  <  -  1 

RETJ1N 

END 
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tapi 


-  CM  SOURCE  STATEMENT  -  IFNI  SI 


c 

~c 

c 

t 

c 


^awruTTHE  MitKPunc.EUi.Tiirciirriffn.iNS.^m 


- TWLMlo 

TMI0020 

1.  AIB  THE  INDEPENDENT  VAKIAAlE  fOl'TWC  TSlSiNEO- 'YfpTooTo 

JNKNONN.  TAP10040 

2.  TT *¥ ~TVfVf  OF  lRDEPMDEir  VALUES.  MUST  8£  Tn - flFIOMO 

IN3REASINC  ORDER.  TRP1006C 


c 

t~ 

c 

r 

c 


I  •  /TIT 

4.  NX 

5.  NPTS 


rrnT~onygygiipgfT  muK. 

NUMBER  OF  POINTS  IN  XT4B. 


FORMULA.  (NFTS-1)  IS  THE  DECREE  OF  THE 


6.  ANS 


C 

C 

C 

C 

C 

xr 


INTERyPUmW  TBHJH  U5E0. 

ORRESFONDING  TO  THE 


— TIM  0876 
TRP10080 
[  nTTaH0090 
TRFIOIOO 


THE  DEPENDENT  VALUE 
VAIJI  OF  >16. 


TIFIffTiO 

TRPI0I20 

rwyreiTff 


i 

i 


DIMENSION  XT  ABI NX) ,  YT  ABI 
NEAR  >  3 
NP  ■  NPTS 

IFINX  .IT.  NP I  NP  ■  NX 
NS  ■  I  NX t 169) /26 
M  ■  N»/2 


T.  NEAR  N ILL  BE  SET  UNE3UAL  ZERO  IF  ARC  IS  NOT  ON  TRP10I40 
XTAB.  ROJTINE  MILL  EXTRAPOl At£.  TRP10150 

NEAR  ■  1,  ARC  .LT.  (TABU)  TRP10160 

NEAR  •  2.  ARC  .5T.  XtABtNX)  TRP10I70 

10  SEPT  64  TRP10180 

.  atwrsnxmfrpToi  no 


NX) 


10 

12 


Am,)30,20,10 


13 

20 

30 

SO 


1  -  l 

IF  IXTABII) 

M  -  3 
NER4  •  31 
CD  T3  73 
NEAR  •  2 
33  T 3  73 
ANS  ■  7 T ABI  I  ) 

G3  T 3  999 
I  •  NX 

IF  IXT43II)  -  413)13,20, 


50 


52 

54 


56 

58 


60 

70 


80 

90 


L  ■  M  ♦  1 
IS  >  NS ♦L 
I F ( NX* I S I 5t, 58, 52 
33  54  I ■! S, NX.NS 
I F ( XT  A3 1 1  )*ARC) 54,20,56 
l  •  I 
33  T3  58 
L  ■  I  -  NS 
03  63  I «L,NX 
IF  IXTA8II)  -  410)60, 20, 
CONTI NJt 
<  •  I  -  IH 
N  ■  X  *  NP  -  1 
ANS  •  3.0 

IF  (N  -  NXI90, 90,80 
N  •  NX 
X  ■  NX-NPM 
03  123  J>K,N 
P  ■  1.3 


73 


TAP  .0200 
TRf  10210 
TRP10220 
TRP10230 
TRP10240 
TRP10250 
TRP10260 
TRP10270 
TRP102P0 
TRP10290 
TRP10300 
TKP10310 
TRP10320 
TRP10330 
TRP10340 
TRP10350 
TKP10360 
TRP10370 
TRP103B0 
TRP10390 
T4P10400 
TRP10410 
TRP10420 
TRP10430 
TAP l 0440 
TRP10440 
TAP10460 
TRP10470 
TRP10480 
TRP10490 
TRP10500 
TRP10510 
TAP10520 
TRP10530 
TAP10540 
TRP10550 
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nn  -  efv  S3uk:e  statement  -  ifvmsi  - 


03  113  l-K.N  TAP10560 

IF  (I*J)100,110,100  fA*il5JT0~ 

100  P  ■  F  *  (ARS  -  X T AB Cl))  t  (XTABU)  -  XTABCl!)  TRP10S80 

110  C3NTHJE  TRF10590 

120  A9S  «  AVIS  ♦  YTABIJI  •  P  TRF10600 

99V  RETJIX  TRF10610 

E90  TRP10&20 


fcFM  SOURCE  STATEMENT  -  JM(S) 


SJBUJTINE  I  1RI  NiXtVt  AMSt  •  ) 

OINE^SI  3N  XMOj  ,  Y(  JO) 

NR1  «  X  -  i 
03  13  J ■ 1 1 NH1 
J<  »  M  -  J 

rVJ1.'"  •  X,JK)  0a»53  TO  10 

10  CONri^JE 

RCfjm 

15  RtlJRMr<  lK>  *  JKJ)  •  imi-YUOl 

CYO 


97 


EM  SOURCE  statement 


IFNI  S  I 


MMT 


TJBAOJTINE  AISSMTIXB.SHC,  •  )  -  — 

subrojtine  for  the  missile  method 

REAL  LLIM,MISL,MXSL,MT,MJ,MCO 
DIMENSION  POI 2,  3), SL I  AO) 

COMMON  ANO{60>,H,DELTA,NS,BETA,U(60),ULlM,LLIM,PS,TA6(Al0)  •SMULT, 
I  XMJLT 

NAMELIST  /OT/  MI SL.MXSL,  M.J,  SM,  SL, ti,NT,  J 
SI  CM  »  -l. 

SL  ■  (J.IM  ♦  LL1MI/2. 

M1SL  ■  l .  EMO 
MX  SL  ■  3. 

03  53  I ■ 1 , NS 
UII)  •  3. 

IFUM3II)  *Gfc .  SLIIMUIDM. 

MJ  •  J( I)  ♦  l. 

IF  1 1  .=3.  1  ICO  ro  20 
n:o  ■  i. 

JJ  •  2 

10  IF ( J J  .ST.  IIC3  TO  20 
J  *  I 
NJ  ■  3 

03  15  <*1,JJ 
MJ  •  MJ  ♦  UIJ) 

J  •  J  -  1 
15  CONTI i JF 

IFIMJ  .EC.  MCOIGO  TO  18 
JJ  ■  JJ  ♦  2 
NCO  ■  MCO  ♦  1. 

C3  T3  13 

IB  SLUM)  -  (SLID  ♦  SL(J*l))/2. 

S3  T3  UO, 40), MU 
20  S3  T 3  1  25,35), MJ 
25  SL  ( I  M  )  -  I  SL  1 1 )  ♦  LLIM/2. 

30  Ml  SL  •  AM  I M 1  I  MI SL , SL 1 1 )) 

S3  TO  53 

35  SL  ( I  M  )  -  (SLID  ♦  ULIM)/2. 

AO  MXSL  •  AMAX 1 1 MXSL , SL ( 1)1 
50  C3NUMJE 
NT  «  3. 

03  55  I  *  1 ,  NS 

IF(S.II)  ,i»T.  Ml  SL  .AMD.  MXSL  .CT.  SLII))MT  ■  NT  ♦  l. 

55  C3NTIMJE 

X3  -  .  5  *  I  MX  SL  ♦  Ml  SL  ) 

SM  ■  (  FLOAT  I  NS )  •  (MXSL  -  MISL)  l/IB.HMT  ♦  2.1) 

J  •  3 

IM  SM  .ST.  3.  ISO  TO  60 
SMC*  3. 

AtTJAM 
60  SJM  •  3. 

SJM1  •  3. 

SJM2  *  3. 

P3( l, 3)  ■  0. 

P 3 ( 2,3)  ■  0. 

03  65  1*1, NS 
1  ■  (SLID  -  Xtt  )/SM 


EFN  SOURCE  S  TATENENT 


IFNI  S) 


MMT 

SS  -  !•  /SORT  1 6. 76 31853)  •  EXPI-T  ••2/2.1 

-  TIT  -  3. 

T2T  •  T 

IF t T  .31.  0.1G3  TO  61 
TIT  -  T 
T2T  -  3. 

61  CM.  I.  ( S3AT  (TlTif2Ti.lt  33,1) 

I F I T  . 5T.  0.)BG*BGt.5 
IF  I T  .LE.  0.)t)3«.5-BG 
HM  >  J(l)/ll.-BG)  -  I  l.-Jt  I )  >/QG 

pan, 3)  -  pqi  l,  3)  ♦  gs  *  hi 

T1  »  T  •  GS  •  HM 
T2  «  f  -  GS»HM 
PQ(2, 3)  -  PO(  2,  3)  ♦  T 1 
SUM  *  SUM  ♦  (GS  •  HM )  **2 
SJM1  «  SUM1  ♦  T 1 • T  2 
SJM2  »  SUM2  ♦  T  **2  •  GS  •  HM  •  T2 
65  CONTIMJE 

Pail.l)  ■  l./SM  •  (PO(2,3)  -  SUM) 

pan, 2)  -  i./sm  •  sum i 

PCX 2, 1 )  *  PQI 1.2)  -  PQ 11,3)  •  l./SM 
P3I2.2)  -  l./SM  • ( SUM2  -  Pat  2, 3) ) 

P3I1.3)  -  PO(l, 3)  •  SIGN 
P3I2.3)  -  PQI  2,  3)  •  SIGN 
CALL  SESOM I(PQ,2,1»0,2,3,D1,R1,E) 

IF  I E  .  E3 .  O.IGO  TO  70 
•X I TE I  5 , 2000  I R1 

2000  FORMAT  H9H  ERR  TR  IN  SES3MI,  E15.8) 

RcTJRM  1 

TO  K3  •  <3  ♦  P3I  1,1) 

SM  •  SM  t  PQI 2,  1 ) 

I F I A3S I  PQI 1 , l ) / XQ  )  ,LT.  .0001  .AND.  ABS(P3<2«1I/SM)  .LT. 
1  .0001  )GC>  TU  75 

J  «  J  ♦  1 

IF  I J  .LE.  loom  TO  60 
Ml I Tt  I  5, 2001 ) 

2001  FORMAT  I  27H  MAI.  NO.  3F  ITERATIONS  ) 

75  SMC  •  SM/BETA 

RET JIM 
CMO 


o  o  o  o  o  o 


ISAT 


EFN  SOURCE  STATEMENT 


If Wt  SI 


-SO«H33nNE  ICTUTTa,Ul,DELTI,»«,TOFqj - fWTooio 

1  LL  LOME*  LIMIT  OF  INTSSRATIONIFLQATING  FT.  I  IGAT0020 

2  OL  JP*E«  UITt  "&rTNTliAATI3N .  I GRT0030 

3  DELTA  STEF  SUE  HO*  SOLJTION  IGRTOOAO 

A  AMS  VALUE"  B*  TRTEGAAL  I GAT 0050 

3  NOEQ  ALL  EQUATIONS  TO  SE  INTEGRATED  MUST  BE  IGRT0060 

TOtTOTTo 
ICATOOSO 
IGAT0090 


M3EQ  IS  TO  BE  USE3  BV  THIS  SUBROUTINE  IGRTOOBO 
TO  5  EVICT  THE  FRdFER  EQUATION  FOR  IGRT0090 

INTEGRATION  IE.  N3E3-1  MILL  BE  TO  INTEGRAIGRTOIOO 

ejjatton  r.  noeu-tto  iNtEsiuf  iffuATTiSN*  icrtouo 

2t  ETC.  THE  F3RN  3F  1NTE3S  MUST  BE...  IGRT0120 

- nnnnnv'.wior  ihhi~  -  -  rmvnt 

1  X  I M3EPENDEMT  VARIABLE  IGRTOIAO 

2  V  DEPENDENT  VAR.  IE.  V-F( X I IGRT0150 

3  NOE 3  SANE  AS  ABOVE.  FROBABLV  IGRT0160 

USED  IN  A  COMPUTEO  GO  TO.IGRTOITO 


11  SEPT  BA 
RALPH  SELLERS 

DIMENSION  F(6),U(6),M3) 

DATA  I J I  I  3 •  1*1.61  /  .11930959,-. 11930939. . 33 060 ABN ,-. 33060A69, 

A  .AS623A76,-«A6623A76  / 

DATA  (All),  1-1,31  /  .23395697,. 18038079,. B3BB22A6E-1  / 

REAL  HIM, MULT, LL 
ULIM  •  JL 
LLIM  •  LL 
MJLT  •  1.0 

IFIJlIN  .GE.  LLIMI  GO  13  5 
TNP1  •  LLIM 
LL IN  «  JLIM 
JL I N  «  TMPl 
MJLT  *-1.0 
5  A  -  ILIN 

DEL  >  ABS( OELTA I 
LAST  «  1 
ANS  ■  3.0 

IF  I  ASS  IULIN-LLIM)  -  .00331  )80,83,10 
10  8  -  A  A  A. O-DEL 
IFI3-JLIMIA0, 30,20 
20  H  •  J.IN 
30  LAST  •  2 
AO  03  53  1-1,6 

X  •  I3-AI-UII)  ♦  . 5» ( A*d) 

CALL  MTEOSIX.FI  I  I.NOtUI 
50  C3NTMJE 

60  ANS  •  ANS  ♦  (B-AI*f4(ll*|FI  l )  *F  I  2  ) )  ♦  A  (  2 >•  I  F  I  3>»F < A))  ♦  R(  3) • 

A  (F(5)»F(6)H 
G3  T 3  1  70,80), LIST 
70  A  •  It 
33  f 3  13 

80  ANS  •  ANS  •  MUL I 
HfcTJAN 
END 


IGRT0180 
IGRT0190 
IGRT0200 
I GRT0210 
IGRT0220 
IGRT0230 
IGRT02A0 
IGRT0230 
I GRT02B0 
IGRT0270 
IGRT0280 
1 3AT0290 
IGRT0300 
IGRT0310 
IGRT0320 
IGRT0330 
IGRT03A0 
IGRT0350 
IGAT03B0 
IGRT0370 
IGRT0380 
IGRT0390 
I  UN  TOAOO 
IGRT0A10 
IGAT0A20 
1 3*7  OA 30 
IGRTOAAO 
IGRT0A50 
IGRI0A60 
URT0A70 
IGAT0A80 
IGHT0A90 
IGAT0500 
IUAT0510 
I GAT 05 20 
I3AT0330 


100 


5E 5000(0 

SUBROUTINE  SESOMI IX ,N,N8,NS,MN 1.NN2. 0,*, El  SE $00020 

— - mS555!T 

I  X  FIRST  LOCATION  OF  INFUT  ARR-f.OIM  AS  XIMN1.NN2ISES00040 

- - 2~N - NUMBER  0?  TWJTUSI  - - - sffoooso 

9  N8  NUMBER  OF  RI6HT  HANO  COLUMN  VECTORS  SES00060 

- WFTFW  1WBB! - - ilfflWTfl 


4  MS 

CHECK  FOR  SIM.  EQS 

OR  INVERSE 

SES00080 

Nr-e*  FOR  StM.  BA. 

sisoooso 

MS-1  FOR  INVERSE 

sesooioo 

S“HWT~ 

ROlTDIICTfTON  HR  M 

IB.tXtHNi.MN2) 

SESOOl 10 

*  NN2  MN2  ■  MNl+NB 


TTJ - TUBE  crw  DTTmiNlNT 


8  R  RANK  OF  THE  MATRIX  SES00140 

9  e  eRRiJf  RETUHr  . .  SESOOISO 


e»0  FOR  NO  ERROR 
E»  l-EBR_fRR5R'  * - 

PI  MENS  I  ON  XmVT7HN3 1  TWWrTTTT .  WVEI101 


SES00160 
SESOOl 70 
SES00180 


DIMENSION  IHL01S0)  SES00200 

DOUBLE  PRECISION  X, WORK.  SA SI, SAVES, V,D. SUM, TEST  SE 500210 

E-0.  SES00220 

R-0.  '  "  SES00230 

00  27  l»l iN  SES00240 

“27  SAVRt 1 1 -X ( 1 , 1  )  “ . .  “  . .  §ES00250 


DO  21  I-l.N 

SES00260 

21 

IHLOm-l 

SES00270 

IF ( RSI  6.4*6 

SES002B0 

6 

NN-NM 

SES00290 

N9-N 

SESOOIOO 

MN-N»l 

SES00310 

03  14  I-l.N 

SES00I20 

03  14  J-MN.NN 

SESOOIIO 

14 

XI  I.JI-3.00 

SES00I40 

03  15  1-1, N 

SESOOISO 

J-  I  *N 

SES00I60 

15 

XI  I,  JI-l.DO 

SES00I70 

S3  13  16 

SESOOIBO 

4 

NN-N4NB 

$‘$00)90 

16 

JJ-NN 

St SQ0400 

SAVEJ-XI l.NRl) 

SES00410 

NNN-N-l 

SES00420 

0-1.33 

SES004I0 

1)3  5  I-l.N 

St $03440 

KX-N-I 

SES00450 

26 

1FI t<) 13.10,26 

SES00460 

LL-«»l 

SES00470 

IJJ-l 

SES00480 

l«I 

St  S00490 

N3RX-X 

SES00500 

03  17  II-l.LL 

SES005 1 0 

03  17  J-l.LL 

SES00520 

IFIASSIrORKI-ABSIXI II, Jin  IB, IT,  17 

SES005IO 

18 

N3RK-XI  1  I ,  J) 

SES00540 

L  •  J  ♦  I  “  l 

SfcS00550 
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APPENDIX  IV 


BRUCETON  ITERATION  PROCEDURE 


When  the  chosen  testing  interval  is  larger  than  2  <x,  or  when  the  inter¬ 
vals  are  of  unequal  size,  it  is  necessary  to  solve  Equations  (1)  and  (2)  for  n 
and  o. 


(1) 

(2) 


The  intervals  will  be  of  unequal  size,  for  example,  when  the  normalizing 
transformation  is  unknown  in  advance  of  the  experiment  and  must  be  deduced 
from  the  results  of  the  experiment  itself.  A  method  of  trial  and  error  is 
probably  as  good  as  any  other  for  solving  the  equations.  One  would  first  choose 
preliminary  estimates,  say  m  and  s,  of  the  roots.  These  preliminary  esti¬ 
mates  would  be  adjusted  until  the  equations  were  satisfied  to  the  desired  degree 
of  approximation.  The  left  side  of  Equation  (1)  will  be  positive  wi  on  the  trial 
value  of  p  is  too  small,  and  negative  when  it  is  too  large.  The  Kft  side  of 
Equation  (2)  will  be  positive  when  a  <<j,  and  negative  when  s  >  <x .  Equation 
(1)  is  relatively  insensitive  to  changes  in  s,  while  the  same  is  true  of  Equation 
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(2)  for  changes  in  m. 

In  order  to  facilitate  the  computations,  the  accompanying  tables  of 

2/p  (Table  14)  and  z/q  (Table  15)  are  provided.  For  negative  values  of 

p,  and  q  are  interchanged,  that  is 

z(x)  _  Z  (-x) 
p(x)  q(-x) 

The  compilation  can  be  illustrated  by  using  the  data  of  Figure  15.  The 
normalized  heights  are  0. 1,  0.9,  1.5,  and  1.9,  as  indicated  in  the  figure. 

The  levels  are  numbered  0,  1,  2,  and  3  beginning  with  the  lowest  level. 

Since  there  are  more  successes  than  failures,  the  latter  are  used  to  deter¬ 
mine  the  estimates.  A  preliminary  estimate  of  fi  may  be  obtained  by  using 
the  average  of  the  midpoints  of  the  intervals  weighted  by  the  numbers  n^; 
thus, 

m,  =  l/29  [2  (1.7)  +  26  (1.2)  +  (0.5)) 

a  1.2. 

A  rough  estimate  of  <r  may  be  determined  by  observing  that  the  interval  0. 9 

NORMALIZED 
HEIGHT 
1.9 
U 
0.9 
0.1 

Figure  15.  Record  of  a  Sample  of  Sixty  Tests 


HUMBER  OF 
x*.  O', 

x  x  x  3 

xxxxxxxxxxOxxxxxx  xxxxxxxxOxxx  27  2 

000  r' 000000  00000x000000000  00  1  26 

0  1 
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Table  14.  '  ’lues  of  z/p 


Values  of  z/p  (Continued) 


rH 

05 

o 

CO 

05 

© 

© 

CO 

00 

rH 

© 

05 

rH 

o 

00 

s 

m 

Hi 

CO 

CM 

Cl 

rH 

rH 

rH 

© 

o 

rH 

rH 

rH 

o 

o 

© 

o 

O 

o 

o 

o 

© 

o 

o 

o 

o 

o 

o 

O 

d 

o 

© 

o 

o 

o 

o 

d 

o 

CO 

rH 

Cl 

in 

© 

00 

c- 

© 

o 

T}< 

© 

Tt* 

rH 

© 

oo 

Cl 

o 

00 

t- 

in 

CO 

CO 

CM 

rH 

rH 

rH 

o 

o 

rH 

rH 

rH 

o 

© 

© 

© 

© 

© 

o 

o 

© 

o 

© 

o 

o 

o 

o 

o 

o 

d 

o 

o 

© 

o 

o 

© 

© 

d 

CO 
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Values  of  zj  q  (Concluded) 


to  1. 5  appears  to  contain  26/ 29  or  about  90  percent  of  the  distribution, 
hence 

1.645  s,s  %  (1.5  -  0.9)  =  0.3 

S]  =  0. 18 

may  be  used. 

In  adjusting  these  estimates  one  might  be  tempted  to  adjust  mt  first  by 
Equation  (1)  and  then  go  to  Equation  (2)  and  adjust  Sj  by  using  a  good  estimate 
of  n.  It  turns  out,  however,  that  the  job  can  be  done  much  more  rapidly  by 
considering  both  equations  together.  The  following  computational  form  may 
be  used: 


(z  z  \  x  z  x  z 

1-1  i\  i  i  i  i 

Vi  pi/  qi  pi 


2  1.9 

3.89 

4.  17 

0 

26  1.5 

1.67 

0.00 

3.48  0.174 

1  0.9 

-1.67 

-2.08 

-0.174  -3.48 

0.1 

-6.  11 

0 

I  Xi-1  Zi-1  Xi  Zi 


6.96 

-9.05 

3.48 


Note  that  this  table  is  arranged  so  that  the  frequencies  of  either  the  0's  or  x's 
will  be  entered  in  the  table  as  though  they  were  x's.  The  symbol  represents 
^  h^  -  m^y/sj  where  h^  is  the  height  and  mt  and  s  i  are  the  first  approximations 
to  n  and  a.  The  other  computations  are  defined  by  the  column  headings.  Thus 
the  figure  4. 17  at  the  top  of  the  fifth  column  is  obtained  as  2  (2. 084  -  0. 000) ; 
2. 084  being  read  from  Table  15  at  x  =  1. 67,  and  0. 000  being  the  value  of  z/p 
at  x  =  3. 89,  as  shown  by  Table  14.  The  sums,  2. 09  and  1. 39,  of  the  fifth  and 
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eighth  columns  give  the  values  of  the  left-hand  sides  of  Equations  (1)  and  (2), 

i 

respectively,  since  both  sums  are  positive.  It  may  be  concluded  that  both  mt 
and  8]  are  too  small.  By  using  m2  «=  1.  3  and  s2  *  0. 19,  the  above  calculation  is 
repeated. 


i 

xi 

.  /wA 

1  X 
►*» 

Xi  Zi 

/Xi-1  Vi  Xi  Zi] 

him 

qi 

Pi 

H  vi  ». ) 

3 

2 

3.  16 

3. 12 

0.01 

3.28 

3 

26 

■ 

1.  05 

-5.85 

1.64 

0.  282 

-9.75 

1 

1 

0.9 

-2.  11 

-2.47 

-0.  093 

-5.21 

5.21 

0 

0. 1 

-6.32 

0 

5.20 

-1.26 

These  results  show  that  the  roots  are  bracketed,  and  good  estimates  of 
H  and  a  may  be  obtained  by  interpolation  between  the  sums.  Interpolating 
between  1. 2  and  1.  3  using  2. 09,  0,  and  -5.  20,  one  finds  that  m3  =  1.  23,  simi¬ 
larly  83=  0. 185.  By  doing  two  more  calculations  similar  to  the  two  illustrated 

above,  one  would  verify  the  third  figures  in  m  and  sand  obtain  good  estimates  for 
the  fourth  figures.  Here,  the  results  to  three  figures  are  m=  1.2  lands  «=  0. 187. 
However,  the  data  do  not  warrant  any  more  accuracy  in  the  roots  than  is  given 
by  m2  and  s2,  and  one  would  not  do  the  two  extra  computations. 
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APPENDIX  V 


STATISTICAL  ANALYSIS 

The  simulation  work  described  previously  in  this  document  was  planned 
and  executed  under  very  closely  controlled  conditions.  The  specific  random 
normal  numbers  selected  for  the  100  samples  for  each  of  the  nine  basic  test 
conditions  were  generated  such  that  it  was  possible  to  repeat  them  exactly  for 
any  subsequent  retesting.  Not  only  did  this  approach  eliminate  any  simulation 
effects  which  vary  with  time,  but  it  also  simplified  the  analysis  of  subsequent 
test  techniques.  Thus,  the  initial  simulations  were  rim  with  essentially  three 
test  techniques :  Normal,  Bruceton,  and  Missile.  Subsequently  the  Improved 
Bruceton  technique  was  simulated  over  the  same  nine  test  conditions,  and  was 
combined  with  the  earlier  simulation  work  for  analysis  as  a  factorial 
experiment. 

1.  Analysis  of  the  Estimated  Means 

The  estimated  means  provided  by  the  different  techniques  were  analyzed 
by  analysis  of  variance.  The  experimental  design  was  a  3  x  3  x  l  factorial 
with  test  technique  (T),  population  (P),  and  sample  size  (S)  as  the  three  factors. 
The  levels  of  all  factors  were  fixed;  two  factors  (population  and  sample  size) 
were  quantitative  and  the  technique  factor  was  qualitative.  The  three  techniques 
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analyzed  were  the  Bruceton,  Missile  and  Improved  Bruceton.  The  so-called 
Normal  technique  was  not  Included  since  it  is  not  a  sensitivity  testing  technique, 
but  only  a  data  analysis  procedure. 

The  experimental  design  arrangement  and  data  for  analysis  are  shown 
in  Table  16.  The  response  variable  selected  and  tabulated  in  the  table  is 
from  Tables  6  (Bruceton  and  Missile)  and  12  (Improved  Bruceton).  This 
variable  is  the  mean  of  the  100  sample  means  from  each  of  the  nine  test  condi¬ 
tions.  To  simplify  analysis,  the  data  from  Tables  6  and  12  were  coded  by  first 
subtracting  —  00000  from  e*1  jh  X_,  and  then  multiplying  the  result  by  100,000. 
The  coded  data  are  shown  in  Table  16. 

Table  16.  Coded  Simulation  Values  of  X_ 

x 


Sample 

Size 

Techu 

Ique 

Bruceton 

Missile 

Improved  Bruceton 

15 

-876 

+406 

+  239 

rH  o  O 

.  <-!  6 

35 

-1854 

+  5 

+  127 

55  11  11 

b 

55 

-1760 

+  21 

+70 

c 

15 

-3869 

+  155 

-50 

o 

-  05 

•H 

-M 

<N  °  ° 

a 

3 

•  rH  © 

o 

35 

-6892 

-186 

-189 

a 

55  11  » 

o 

PH 

a.  b 

55 

-5988 

-185 

+67 

15 

-4402 

-1292 

-498 

PO  ON 

.  >h  © 

o 

35 

-7303 

-331 

+  885 

£  »  11 

a.  b 

55 

+  920 

!  +437 

+  1312 

T  . 

-32,024 

-970 

-1963 

•J 

X 

-3558 

-108 

+218 

•j 

Coded  X_  = 
x 


(x?-  l.ooooo)  105 
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The  mathematical  model  for  the  experimental  design  and  analysis  is 


given  as 


V  ="  + W  TSiJ  +  Pk  +  PTki +  %  +  e!Jk 


In  this  model 


X...  =  observations  on  the  response  variable  X_ 
ijk  x 

H  =  a  common  eff  ct  in  all  observations 


=  the  testJ-if  technique  effect  where  i  =  1,  2,  3 
=  sample  size  effect  where  j  =  1,  2,  3 
P  =  population  effect  where  k=  1,  2,  3 

K 

e ...  =  the  randon'  experimental  error. 

Ijk 

The  other  terms  represent  the  interactions  between  the  main  factors  T,  S,  and 


The  results  of  the  analysis  of  variance  calculations  are  shown  in  Table 
17.  Two  of  the  three  factors  were  found  to  be  significant.  Technique  was  found 
to  be  highly  significant,  the  F  test  resulting  in  significance  at  a  confidence  level 
exceeding  99  percent.  A  similar  test  of  the  population  effect  revealed  signifi¬ 
cance  at  the  90  percent  confidence  level. 

Multiple- range  tests  of  both  factors  were  conducted  according  to 
Duncan's  procedure. 26  It  was  found  that  the  means  of  the  Improved  Bruceton 
and  Missile  techniques  were  both  significantly  different  from  (at  the  99-peicent 
confidence  level)  and  better  than  the  Bruceton  technique.  Also,  no  significant 
difference  was  detected  between  the  Improved  Bruceton  and  Missile  techniques. 
Thus,  the  Improved  Bruceton  and  Missile  techniques  give  essentially  the  same 
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Table  17.  Analysis  of  Variance  of  Simulation  X_  Data 

x 


Source  of 
Variation 

Degrees 

of 

Freedom 

Sum  of 
Squares 

— 

Mean 

Square 

A 

F 

Technique  (T) 

2 

78,  817,  492 

39,  408,  746 

24.69* 

Population  (P) 

2 

10,  148.  468 

5,  074,  234 

3.  18** 

Sample  size  (S) 

2 

6,  286,  428 

3,  143,  214 

1.97 

T  x  p  interaction 

4 

15,  954,  136 

3,  988,  534 

2.50 

T  x  S  interaction 

4 

9,  888,  806 

2,  472,  201 

1.55 

P  x  S  interaction 

4 

14,  927,  324 

3,  731,  831 

2.34 

e,„  -  error 
ijk 

8 

12,  770,  064 

1,  596,  258 

— 

26 

148,  792,  718 

*  Significant  at  99-percent  confidence  level. 
**  Significant  at  90-percent  confidence  level. 


results  for  estimating  the  means,  and  both  techniques  are  significantly  better 
than  the  Bruceton  technique. 

Multiple-range  tests  of  the  population  effect  revealed  that  there  was  no 
significant  difference  (at  the  95-percent  confidence  level)  between  the  estimates 
of  the  means  from  populations  No.  1  and  3,  and  populations  No.  2  and  3.  There 
was  a  significant  difference  detected  between  estimates  from  populations  No.  1 
and  2.  These  results  indicate  that  the  population  effect  is  nonlinear  since  the 
estimates  from  populations  No.  1  and  3  (a=  0.  02  and  a=  0.26,  respectively) 
are  more  accurate  than  estimates  from  population  No.  2  (a  =  0.  09).  This 
effect  is  probably  due  to  not  controlling  the  mean  of  the  samples  from  the 
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a  =  0.  09  population  closely  enough  to  the  desired  value  of  ^  =  1.  00. 

These  results  indicate  that  the  most  accurate  mean  estimates  will 
result  when  either  the  Improved  Bruceton  or  Missile  technique  is  used,  and 
further,  that  accuracy  will  be  greatest  from  populations  of  m  =  1.  00,  a  =  0.  02; 

H  «=  1.  09,  a  =  0.  26;  and  n  =  I.  00,  cr  =  0.  09,  accuracy  decreasing  in  that  order. 

To  further  evaluate  the  mean  estimates,  the  standard  deviations  of 
these  estimates  were  analyzed  by  the  sign  test  as  described  by  Dixon  and 

Massey. 27  The  hypotheses  listed  below  were  tested: 


H°:  ^S(M)  “  ^S(N) 

H,: 

^S(M) 

*  MS(N) 

H°:  ^S(I)  =  MS(N) 

Hj: 

MS(I) 

*  MS(N) 

H°:  ^S(B)  =  MS(M) 

Hi: 

MS(B) 

*  M3(M) 

H°:  **S(B)  ~  %{l) 

Ht: 

MS(B) 

*  MS(I) 

H°:  MS  (I)  =  MS(M) 

Hi: 

u 

S(I) 

*  ^S(M) 

where  the  expression,  u  ,  refers  to  the  mean  of  the  standard  deviations  of 

S  (M) 

the  Missile  technique.  The  subscripts  I,  B,  and  N  refer  to  the  Improved 

Bruceton,  Bruceton,  and  Normal  estimates,  respectively.  Only  the  last  null 

hypothesis  listed  above  was  accepted;  the  other  four  were  rejected  at  the  99- 

percent  confidence  level.  Inspection  of  the  values  of  u  ,  and 

S  (B)  S  ( / 

^  .  showed  that  n  was  the  largest,  indicating  that  the  Improved  Bruceton 

S(I)  S(B) 

and  Missile  techniques  are  both  better  than  the  Bruceton. 

It  is  concluded  that  the  standard  deviations  of  the  mean  estimates  of  the 
Missile  and  Improved  Bruceton  techniques  are  equivalent,  and  both  are  better 
(l.e. ,  smaller)  than  the  Bruceton  mean  estimate  standard  deviations. 
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2.  Analysis  of  the  Estimated  Standard  Deviations 


The  distributions  of  the  estimated  standard  deviations  of  the  three  tech¬ 
niques  are  not  known,  and  therefore  only  distribution-free  tests  were  applied  in 
the  analysis  of  these  estimates.  Thus,  sign  tests  of  the  values  of  from 
Table  6  were  conducted.  Since  the  standard  deviation  estimating  procedures  of 
the  Improved  Bruceton  and  Bruceton  techniques  are  identical,  only  a  compari¬ 
son  between  the  Bruceton  and  Missile  techniques  was  conducted.  The 
hypothesis  tested  was 

H°:  ,US(B)  =  MS(M)  H‘:  ^S(B)  *  ^S(M)  ’ 

The  null  hypothesis  was  rejected  at  the  95-percent  confidence  level,  and  it  was 
concluded  that  the  mean  of  the  Bruceton  standard  deviation  estimates  is  signifi¬ 
cantly  different  from  the  mean  of  the  Missile  estimates.  This  hypothesis  test 
did  not  give  any  information  as  to  which  of  the  two  techniques  is  the  most 
accurate,  and  further  testing  was  necessary  to  complete  the  evaluation.  The 
following  additional  hypothesis  test  on  the  means  was  conducted: 

H°:  *S(M)=  ^S(N)  Hj:  ^S(M)  *  ^S(N)  ’ 

The  null  hypothesis  was  accepted  at  the  95-percent  confidence  level. 

Hypothesis  tests  of  the  mean  standard  deviation  of  the  standard  deviation  esti¬ 
mates  were  also  conducted.  These  were  as  follows: 


H0: 

^SS(M)  "  MSS(N) 

H,= 

^SS(M) 

4  u 

mSS(N) 

H0: 

MSS(B)  =  MSS(N) 

MSS(B) 

*  p 

SS(N) 

H0: 

^SS(M)  =  MSS(B) 

Hi: 

^SS(M) 

*^SS(B)  ' 

All  three  null  hypotheses  were  rejected  at  the  95-percent  confidence  level. 
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Inspection  of  the  values  of  p  ^  and  ^gg^M)  showed  that 

smallest,  and  it  is  concluded  that  the  Bruceton  technique  provides  standard 

deviation  estimates  with  the  best  repeatability  (i.e. ,  smallest  variation;. 

In  summary,  the  sign  tests  of  the  standard  deviation  estimates  of  the 
three  techniques  were  inconclusive.  The  tests  indicated  that  the  means  of  the 
Missile  estimates  are  better  but  that  the  standard  deviations  of  the  Missile 
estimates  are  not  as  good  as  the  Bruceton  (and  Improved  Bruceton). 


3.  Analysis  of  the  Correlation  Coefficients 

The  values  of  TAUB  and  TAUM  tabulated  in  Table  8  are  estimates  of  the 
true  correlation  coefficients  p^  and  p^,  respectively.  Analysis  of  these  data 
consisted  of  making  the  following  hypothesis  tests  at  each  of  the  nine  test 
conditions: 


H0:  P B  =  0  H  PB  >  0 

h':pm=0  h>:pm>0' 

Similar  tests  were  made  with  combined  or  mean  estimates  at  the  different 
values  of  sample  size  and  for  the  different  populations.  All  tests  were  made  at 
a  confidence  level  of  90  percent  according  to  the  procedures  described  by 
Dixon  and  Massey. 27  These  procedures  make  use  of  the  fact  that  the 
variable 


Z=  (0.5)  In  (1+  y/1  -  y) 

is  normally  distributed  with  mean  and  standard  deviation 

Mz=  (0.5)  in  (1+  p/1  -  p) 
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crz  =  1/VN^I  , 

where  y  is  the  estimate  of  p. 

The  results  of  this  analysis  are  indicated  in  Table  8.  A  "yes"  in  the 
column  headed  '  Significant  at  90-Percent  Confidence"  indicates  that  the  null 
hypothesis  is  rejected  and  the  conclusion  is  made  that  there  is  positive  correla¬ 
tion.  A  "no"  indicates  no  correlation  between  the  Bruceton  (or  Missile) 
estimates  of  standard  deviation  and  the  corresponding  Normal  estimate,  i.e. , 
p  =  0.  Standard  deviation  estimates  at  these  test  conditions  (where  p*  0)  are 
unacceptable  and  these  particular  test  conditions  should  be  avoided. 
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GLOSSARY 


Bruceton  iterative  procedure  —  one  of  three  procedures  available  for  calculat¬ 
ing  estimates  of  /u  and  a  from  Bruceton  tesv.  data.  It  is  not  the  procedure 
described  for  the  standard  Bruceton  technique.  The  procedure  is  of  an 
iterative  type  in  that  initial  values  are  chosen  and  manipulated  through 
the  mathematical  procedures  and  more  accurate  values  obtained.  This 
may  be  continued  until  the  change  between  successive  iterations  is  as 
small  ao  desired.  This  procedure  is  described  in  detail  in  Appendix  IV. 

Comparison  oimulations  —  the  simulation  effort  described  in  Chapter  III  in 

which  tests  at  the  nine  basic  test  conditions  shown  in  Table  1  were  sim¬ 
ulated  with  the  standard  Bruceton  and  Missile  techniques. 

Degenerate  solution  —  under  certain  conditions  estimates  of  the  standard  devia¬ 
tion  from  test  data  generated  by  the  Missile  technique  assume  negative 
values.  These  negative  solutions  for  c  are  called  "degenerate  solutions" 
by  Langlie,  17  and  he  states  that  when  such  solutions  occur,  the  value  of 
or  =  0  should  be  used. 

Improved  Bruceton  technique  —  a  sensitivity  test  technique  which  combines  the 
standard  Bruceton  test  procedure,  standard  Bruceton  estimates  of  a, 
and  iter  ative  (as  opposed  to  the  standard)  Bruceton  mean  estimates  into 
a  single  overall  technique.  This  technique  is  the  same  as  the  standard 
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Bruceton  except  that  an  iterative  procedure  is  substituted  for  estimating 
the  mean. 

Missile  iterative  procedure  —  a  procedure  by  which  the  test  data  generated  by 
the  Missile  technique  are  analyzed  and  estimates  of  p  and  <x  are  calcu¬ 
lated.  The  procedure  is  of  the  iterative  type  and  is  the  only  procedure 
used  with  the  Missile  technique. 

Re- Test  —  Simulation  effort  at  one  of  the  nine  specific  test  conditions  other 

than  the  comparison  simulations.  Re-tests  are  done  primarily  to  evalu¬ 
ate  changes  of  the  standard  sensitivity  test  techniques. 

Sample  —  a  group  of  random  Normal  numbers  generated  by  the  simulation 
program  to  represent  one-shot  hardware  undergoing  sensitivity  test. 

The  number  of  random  Normal  numbers  in  the  sample  (i.  e. ,  the  sample 
size)  is  specified  by  the  particular  test  condition.  The  "items"  in  a 
sample  are  also  referred  to  as  "test  items. " 

Simulation  run  size  —  the  number  of  samples  of  random  Normal  numbers 
"tested"  during  a  particular  simulation  effort. 

Test  or  simulated  test  —  the  activity  of  comparing  an  individual  random  Normal 
number  of  a  sample  to  a  test  level  generated  by  one  of  the  sensitivity 
test  techniques,  and  noting  whether  the  number  is  greater  than,  less 
than,  or  equal  to  the  test  level.  If  the  number  is  greater  than  or  equal  to 
the  test  level,  the  test  is  scored  a  success,  otherwise  the  test  is  scored 
a  failure. 

Test  level  —  a  specific  value  of  the  test  stimulus  or  environment,  as  determin¬ 
ed  by  the  sensitivity  test  techn.  que,  at  which  a  particular  test  item  is 
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tested.  Test  levels  are  represented  In  the  simulations  by  appropriately 
derived  numbers. 


127 


UNCLASSIFIED 


3*curttj^lii*ifjc»tion 


DOCUMENT  CONTROL  DATA  .  R  &  D 


Teal  ancf  &e^ia&IfftyEvalua13fon  Laboratory 

Research  and  Engineering  Directorate 

U.  S.  Army  Missile  Command 

Redstone  Arsenal,  Alabama  35809 

I*.  REPORT  SECURITY  CLASSIFICATION 

Unclassified 

IB.  GROUP 

NA 

1.  RIRORT  TITLE 

SENSITIVITY  TESTING  OF  ONE-SHOT  ITEMS 

«.  DC1CRIPTIVC  NOTCI  (Typ*  ol  report  mnd  Inclutlrm  dst,.) 

Test  Evaluation  Report 

s-  author!*)  (Hrat  nmmo,  m tddla  Initial,  Imat  nama ) 

Carl  Edward  Roberts 

•  ■  REPORT  OATE 

5  February  1970 

7«.  TOTAL  NO.  Of  f  ASEI  7*.  NO.  OP  ACPI 

139  27 

M.  CONTRACT  OR  ORANT  NO. 

6.  PIOJtCT  NO.  (  DA)  1L01300191A 

AMC  Management  Structure  Code  No. 
5016.11.844 

d. 

M.  ORIGINATOR* •  REPORT  NUMBER!*) 

RT-TR-70-1 

M.  OTHtn  NKPONT  NOttl  (Any  otftai  nunkara  Mil  may  ka  MIlfMd 
dill  nporl) 

AD 

10  TfJs  ^ocurn'en{  Vs*subject  to  special  export  controls  and  each  transmittal  to  foreign  govern¬ 
ments  or  foreign  nationals  may  be  made  only  with  prior  approval  of  this  Command, 

ATTN:  AMSMI-RT. 

II.  SUPPLEMENTARY  NOTES 

None 

12.  SPONSORING  MILITARY  ACTIVITY 

Same  as  No*  1 

FI®.  ABSTRACT 

Sensitivity  testing  as  applied  to  one-shot  items  consists  of  subjecting  individual  one- 
shot  test  items  to  discrete  levels  of  a  test  environment,  operating  the  test  item  and  noting 
whether  or  not  the  item  functions  properly.  From  this  type  of  test  a  direct  measurement  of 
the  strength  of  the  test  item  is  not  obtained,  only  the  information  that  the  strength  is  either 
greater  than  or  less  than  the  test  level  used.  In  order  to  obtain  more  meaningful  information 
from  these  "quantal  response"  data  it  is  necessary  to  use  special  techniques  or  procedures 
both  to  conduct  the  tests  and  to  analyze  the  data. 

This  investigation  was  directed  toward  testing  one-shot  items  associated  with  Army 
missiles,  e.  g. ,  thermal  batteries,  squibs,  explosive,  etc.  The  specific  objectives  of  the 
investigations  were  (1)  to  evaluate  available  techniques  for  conducting  sensitivity  tests  of 
one-shot  items,  (2)  to  improve  existing  techniques  or  develop  an  improved  one,  (3)  to 
identify  the  best  technique,  and  (4)  to  identify  and  evaluate  any  limitations  of  the  best  tech¬ 
nique  as  identified  from  (3)  above. 

The  approach  taken  was  to  simulate  sensitivity  testing  with  the  different  techniques 
on  a  digital  computer.  A  simulation  program  was  developed  and  the  different  techniques 
programmed  for  testing  under  closeby  controlled  conditions.  In  this  way  it  was  possible  to 


control  all  inputs,  providing  accurate  data  for  comparison  and  evaluation  of  the  testing 
techniques. 

The  Bruceton  or  Up  and  Down  technique,  and  a  technique  developed  by  an  Army  mis¬ 
sile  contractor  referred  to  as  the  missile  technique,  were  the  two  techniques  given  primary 
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consideration,  ihe  investigations  revealed  that  the 
missile  was  superior  to  the  standard  Bruceton  in 
providing  estimates  of  the  mean  failure  strength  of 
test  items.  The  missile  technique  estimates  were 
from  1  to  32  percent  more  efficient  than  the  Bruceton. 
Other  characteristics  of  both  techniques  were 
evaluated  and  specific  limitations  of  each  technique 
identified. 
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